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MEIHOD AND SYSTEM FOR SENSING DEVICE REGISTRATION 
PIELD OF INVENTION 

The present inveniion relates generally lo meihods, systems and apparatus for interacting with computers. More 
particularly, the invention relates to registration of a sensing device for use with a computer system, utilizing such 
systems, methods and apparatus. 

The invention has been developed primarily to allow a large number of distributed users to interact with 
nctwortced information via printed matter and optical sensom^ thereby to obtain (ntmctive primed moiter on demand via 
high-speed networked color printers. Although the invention will largely be described herein with reference to this use, it 
will be appreciated that the invention is not limited to use in this field. 
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1 0 CO-PENDING APPLICATIONS 

Various methods, systems and apparatus relating to the present invention are disclosed in the following co^ 
pending applications filed by the applicant or assignee of the present invention simultaneously with the present 
application: 

PCT/AUOa/00761, 
PCT/AU0O«)O766, 
PCT/AUOO/00775. 
PCT/AU0(VDO77l, 
PCr/AUGO/00757 

The disclosures of these co-pending applications are incorporated herein by cross-reference. 

20 Various methods, systems and apparatus relating to the present invention are disclosed in the following co> 

pending applications filed by the applicant or assignee of the present invention on 24 May 2000: 

PCT/AU00/0O518, PCTMUOO/00519, PCr/AUO0/0O52O, PCT/AU00/0052I, PCT/AU00/OO523, 

PC17AU00/0O524. PCTMUOO/00525, PCT/AUOO/00526. PCTMUOO/00527, PCTyAUOO/00528. 

PCT/AU00AK)529. PCT/AU0(y00530, PCT/AUO0y0053l. PCTMUOO/00532. PCT/AU00rtW533. 

25 PCT/AUOO/00534, PCT/AUOO/00535. PCr/AUOO/00536, PCT/AUOO/00537. PCTyAUOO/00538. 

PCT/AUOO/00539, PCT/AUO(VOO540. PCT/AUOO/00541. PCT/AUO0yOO342. PCT/AUO0/OO543, 

PCT/AU00/00544, PCT/AUOO/00545, PCT/AUOO/00547, PCT/AU 00/00546, PCTyAUOO/00554, 

PCI/AU00/0O5S6. PCT/AU00/00SS7. PCT/AUOQ/00558, PCT/AU00/O0559. PCT/AU00y0036O, 

PCr/AUOO/00561, PCr/AUOO/00562, PCT/AU(K)/00563, PCr/ALIOO/00564. PCTyAUO0yO0366. 

30 PCTVAU00/00567, PCT/AU0O/0O568, PCT/AUOO/00569. PCryAU0QAK)570, PCTyAUOOyO057l. 

PCT/AUOO/00572, PCT/AU00A)0S73. PCT/AUaO/00374, PCTMU00A»0575. PCTyAUOO/00576t 

PCr/AUOO/00577, PCT/AU00«)0578, PCT/AUOO/00579, PCT/AUO0/O05gl, PCT/AUOO/00580, 

PCI7AU00/aO582, PCT/AUOO/00587. PCT/AUOO/00588, PCT/AUOO/OOSSQ, PCTyAUOO/00583, 

PCT/AUOO/00593, PCT/AU0O/0O39O, PCT/AUO0/0039I, PCT/AUO0A)0392, PCTyAUOO/00394, 

35 PCr/AUOW00593, PCT/AUOO/0059fi, PCr/AUO0AM)397, PCTMUOO/00398, PCT/AUOO/00516, 
PCT/AUOOA)05 1 7 and PCT/AUO0rt)05 1 1 
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Ihe disdosiires of these oo-pending applications are inoocporated herein by aoss-ieference. 

BACKGROUND 

Users of a computer system an often tequiied to l>e registeied with the oompuler system, and must then 
provide some kind of idcatiGcation information before being allowed to zcass the computer system. Identification 
information may be provided in the form of textual infonnation entered via a keyboard, in the form of infonnation stored 
on an access token such as a smart card, or in the form of biometrte information captured by the ^stem. User legistratiofn 
allows a computer system to control access to its resources, and allows it Co provide users with implicit access to their data 
and preferences as soon as tliey are identified. 

OBJECT 

It is an object of the present invention to provide a new method and system for registration of a sensing 
device for use with a computer ^steta 

SUMMARY OF INVENTION 

In accordance with the invention, there is provided a method for registration of a sensing device for use widi 
a computer system, the method includes providing a printed registration form including registration infonnation and 
coded data theicon, the coded data including an indication of an identity of the form and at least one rcfcicuoc point on 
(he form. The method also inchides receiving in the computer system indicating data from a sensing device, the indicating 
data inchtding Information regarding an identity of the sensing device, die identity of the form and at least one action of 
the sensing device in relation to the form generated by tiie sensing device using at least some of the coded data. The 
method forther includes deriving, from the indicating data, a correspondence between a registered user of the computer 
system and the identity of the sensing device; and stoiii^, in the computer ^siem, registration data a!^«>cinting an identity 
of the registered user with (he identity of the sensing device. 

In a preferred implementation of the invention, the at least one action of the sensing device in relation to the 
registratira form includes die formation of handwritten text and/or markings on the fona The indicatiiig data regardirig 
the formation of handwritten text and/or markings on ttie registration form is preferably used to derive die identity of the 
registered user firom infonnation stored in the computer system. 

In one form of (he invention, the method includes the step of using the indicating data regarding the 
formation of handwritten text and/or maifcings on die registration form to generate, ftom information stored in the 
computer system^ a list form indicating registered usen ooncsponding to die indicating data^ the list form having coded 
data including an indication of an identity of die list form and at least one reference poim on the list form. In that case, 
the method may also include the step of receiving In die computer system further indicating data ftom the sensing device, 
the further indicating data including infonnation regarding die identity of the list form and at least one action of the 
sensing device in relation to the list form generated by the sensing device using at least some of the coded data, die further 
indicating data being used to determine one of the listed registered users for correspondence widi die sensing device. 

In one form of the invention, the method includes: 

providing a first printed form including registration information and coded data diereon, die coded data 
including an indication of an identity of die fona and at least one reference point on die form; 

receiving in tiie computer system indicating data from a registered sensing device, the indicating data 
including information regarding an identity of said registered sensing device, the' identity of the form and at least one 
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Bcdon of said registered sensing device ia relation to the form generated by said legistercd sensing device usi^g at least 
some of the coded data; 

idenli^^ a legistered user of the oonputer system from information stored in the computer system using & 
stored oofrespondence between the registered user and the received identity of said registered sensing device: and 

5 generating said registration fonn, wherein the registration information includes an indication of the identity of 

the registered user. 

hi one form of the invention, the method includes receiving In the computer system authorizing dau from a 
second sensing device, the authoriziqg data including infonnalion regaidtng the identity of the second sensing device* die 
identity of the rcgistiBtion foim and at least one action of the second sensing device in relation to the registration form 
1 0 generated by the second sensing device using at least some of the coded data, the second sensing device being associated 
in the computer system widi m second registered user authorized to permit sensing device registrations. 

Preferably the registration fonn b printed on demand on the surface of a sheet material including printing 
said coded dau Ihenoo. ITie coded dau is preferably printed so as to be at lease substaniiaUy invisible in the visible 
spccfninv 

15 In accordance with the present invention* there is also provided a system for registntion of a sensing device 

for use with a computer system. The system includes: 

a printed registration form including registration information and coded dau thereon, the coded dau 
including an indication of an identity of the form and at least one reference point on the fonn; 

a computer system adapted to receive Indicating dau ftom a sensing device, the Indicating dau including 
20 information regarding an identity of the sensing device, the identity of the form and at least one action of the sensing 
device in relation to the form generated by the sensing device usmg at least some of the coded data, the computer system 
including: 

processing means for deriving, horn the indicating data, a correspondence between a registered user of the 
computer system and tfie identic of the sensing device; and 

25 dau storage for storing registration daU associating an identity of the registered user with the identity of the 

sensing device. 

In a preferred implementation of the invemion, the at least one acdon of the sensing device In relation to the 
registration form includes the fonnation of handwritten text and/or maridngs on the form. The indicating dau regarding 
the fbrmadon of handwritten text and/or markings on the rc^stration form is preferably used to derive the identity of the 
30 registered user from information stored in the dau storage of the computer system. 

One fomi of the invention includes a list form indicating registered users corresponding to the indicating daU 
and coded data, the coded dau including an indication of an identity of the list form and at least one reference pmnt on 
the list form, the list fbnn being generated, from Information stored in the computer system, using the indicating dau 
regarding the formation of handwritten text and/or maricings on the registration form. 

35 Preferably the system includes the sensing device which contains an identifieadon means that imparts a 

unique identity to the sensing device. 

The system m^ also include a second sensing device widt corresponding registration dau stored in die dau 
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stoiage associating the identity tbeeeof with the registered user. 

Ihe system pieferably also includes a printer for printing the registration form on demand. The legistntion 
form is preferably printed on the surface of a sheet material including printing said coded data diereon. Further. Ihe coded 
data is preferdbly printed so as lo at least substantially invisible in the visible spectiuro. 

5 BRIEF DESCRIPTION OF DRAWINGS 

Preferred and other embodiments of the invention will now be described, by way of non-limiting example 
only, with reference to the accompanying drawings, in which: 

Figure 1 is a schematic of a the relationship between a sample printed netpage and its online page description; 

Figure 2 is a schematic view of a interaction between a netpage pen, a netpage printer, a netpage page server, and a 
1 0 netpage application secver. 

Figure 3 illustrates a collection of netpage servers and printen interconnected via a network; 

Figure 4 is a schematic view of a high-level structure of a printed netpage and its online page description: 

Figure S is a plan view showing a structure of a netpage tag; 

Figure 6 is aptan view showing arelationship between a set of the tags shown in Figure S and a Tield of view of a netpage 
1 5 sensing device in the form of a netpage pen; 

Rgure 7 is aflowchart of alae image processing and decoding algorithm; 

Figure 8 is a perspective view of a nequgc pen and its associated cag-sensing fieU-of-view cone; 

Figure 9 is a perspective exploded view of the netpage pen shown In Figure 8; 

Figure 10 is a schematic block diagnun of a pen controller for die netpage pen shown in Figures 8 and 9; 

20 Figure 11 is a perspective view of a wall-mounted netpage printer. 

Kgure 12 is a section through the length of the netpage printer of Figure U; 

Figure 12a is an enlarged portion of Figure 1 2 showing a section of the duplexed print engines and ghie wheel assembly; 

Figure 1 3 is a detailed view of the ink cartridge, ink, air and g^ue padis, and print engines of the netpage printer cf Hgures 
Hand 12; 

25 Figure 14 is a schematic block diagram of a printer controller for the netpage printer shown in Figures 1 1 and 12; 

Figure 15 is a schematic block diagram of duplexed print engine controllers and Memjet"* prinlheads associated with the 
primer oontroller shown in Figure 14; 

Figure 16 is a schematic block diagram of the prim engine cootioUer shown in Figures 14 and tS: 

Figure 17 is a perspective view of a single Memjet™ printing element, as used in, for example, the netp^e printer of 
30 Figures 10 to 12; 

Figure 18 is a perspective view of a small part of an anray of Memjet™ printing elements; 

Figure 19 is a series of perspective views ilhistrating the operating cycle of the Memjet™ prindr^ element shown in 
Figure 13; 
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Hgiae 20 is apeispective viewof a shortscgmenlof aiMgewidtti Menjet™ priothead; 

Figure 21 is a schematic view ofa user class diag^aoi; 

Hguie 22 is a schematic view of a priater dass diagiam; 

Flguie 23 is a schenuttic view ofa pen class diagram; 
5 Figure 24 is a schematic view of an application class diagram: 

Figure 25 is a schematic view of a document and page description dass diagram; 

Figure 26 is a schematic view ofa document and page ownership dass diagram; 

Figure 27 is a schematic view ofa terminal dement speciaKzadon dass diagram: 

Hgure 28 is a schematic view ofa static ekment spedaUiarion class diagram; 
1 0 Figure 29 is a schematic view of a hyperlink element class diagnm; 

Figure 30 is a schematic view ofa hypertlok element spedalization dass diagram; 

Rgure 31 is a schematic view of a hyperlinked group dass diagram; 

Figure 32 is a schematic view of a form dass diagram; 

Bgure 33 is asdicmadc view of adigital ink dass diagram: 
1 5 Figure 34 is a schematic view of a field element spedalizadon class diagram; 

Figure 35 is a schematic view of a checkbox fidd class diagram; 

Hgure 36 is a schematic view ofa text field class diagram; 

Figure 37 is a schematic view of a signature field class diagram; 

Hgure 38 is a fiowdiart of an input processing algorithm; 
20 Hgure 38a is a detailed flowchart of one step of die flowdiart of Figure 38; 

Hgure 39 is a sdiematie view of a paga server command element class diagram; 

Hgure 40 is a schematic view of a subscription ddiveiy pcoioool; 

Hgure 41 is a schematic view of a hyperlink request class diagram: 

Hgure 42 is a schemadc view ofa hyperlink acdvation protocol; 
25 Hgure 43 is a schematic view of a form submission protocol; 

Figure 44 is a schematic view ofa set of user ioter&oe flow documeai icons; 

Hgure 45 is a schematic view of a set of user interfoce page layout dement icons; 

Hgure 46 is aschematie view ofa user reglsiraiion user interfiioe flow; 

Hgure 47 is a schematic view of a user re^straiion foim: 
30 Hgure 48 is a schematic view of a pen registration user interface flow; 

Hgure 49 is a schematic view of a pen registration foim; 
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Figure SO is a schematic view of a pen registration matehing users page; 
Figure SI is a schematic view of a pen registration local useis page; 
Figure 52 is a schematic view of a user authorization user interface flow; 
Figure S3 is a schematic view of a user authorization form; 
Figure 54 is a schematic view of a user authorization matching users page; and 
Figure 55 is a schematic view of a user authorization global itsets page. 

DETAILED DESCRIPTION OF PREFERRED AND OTBOeR EMBODtMErOS 
Note: MejnjetTM u a trade mark of Silverl)n)ok Research Piy Ltd, Australia. 

In the pztferred embodiment, the invention is configured to work with the netpage networiccd computer 
system, a detailed overview of which Ibllows. It will be appreciated that not every implenMntadon will necessarily 
eRd)ody all or even noost of the specific details and extensions discussed below in relation to the basic systcnx However, 
the system is described in its most oon^ete form to reduce the need for external refiertnoe when attempting to understand 
Che context in which the preienrcd embodiments and aspects of the present invention operaie. 

In brief summary, the preferred form of the netpage system employs a computer interface in the form of a 
mapped sur&ce, diat is, a physica] surface which oomatns references to a map of die surface mamtained in a coiqiuter 
system. The map references can be queried by an appropriate sensing device. Depending upon the specific 
implementation, the map references may be encoded visibly or invisibly, and defined in such a way that a local query on 
the mapped surface yields an unamlngaaus map reference both within the map and among different maps. The computer 
system can contain infonnatiOD about features on the mapped surfiace, and sudi information can be retrieved based on 
map references supplied by a sensing device used with the mapped surface. The information thus retrieved can take tlie 
form of actions «4)icb are initialed by the computer system on behalf of the operator in response to die operator's 
interaction with the surface feaniies. 

In its preferred fbrin. the netpage system itltes on the production of, and human interaction widu aetpages. 
Tliese are pages of text, graphics and images printed on ordinary paper, but which work like interactive web pages. 
Information is encoded on each page using ink which is substantially invisible to the unaided human eye. The ink, 
however, and diereby the coded data, can be seiised by an optically imaging pen and transini^ 

In the piefentd form, active buttons and fayperilnks on each page can be clicked witti the pen to lequest 
information from the network or to signal preferences to a network server. In one embodiment, text written by hand on a 
netpage is automatically recognized and convened to computer text in the netpage system, allowing forms to be filled in. 
In other embodiments, signatures recorded on a netpage are automatically verified, allowing e-commerce traosactioiis to 
be securely authorized. 

As ilhistraled in Figure 1, a printed netpage 1 can represent a interactive form which can be filled in by the 
user both physically, on the printed page, and "'electronically**, via conununication between the pen and the netpage 
sysiem. The example shows a "Request" form contahUng name and address fields and a submit buttoa The netpage 
consists of gfaphic data 2 printed using visible ink. and coded data 3 printed as a collection of ti^ 4 using invisible ink. 
The corresponding page description S, stored on the netpage network, describes die individual elements of the netpage. In 
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paiticular it describes ihe lypc and spatial extent (zone) of each interactive element (i.e. text field or button in the 
example), to allow Ihe netpa^c system to coirectly inteipret input via the nctpagc. The submit button 6. for example, has a 
zone 7 which corresponds to the spatial extent of the conesponding graphic 8. 

As iUustraled in Figure 2. Ihe neipage pen 101. a preferred form of which b shown in Figures 8 and 9 and 
5 described in more detail bdow, wortcs in conjunction with a neipage printer 601. an Internet-connected printing appliance 
for home, office or mobile use. Ihe pea b wireless and communicates securely with the netp^ge printer via a short-range 
nMliolin)c9. 

The netpage piinier 601 , a preferred form of which is shown in Figures 1 1 to 13 and described in more detail 
below, is able to deliver, periodically or on demand, personalized newspapers, magazines, catalogs, brochures and other 
1 0 publications, all printed at high quality as imcractive netpages. Unlike a personal computer, d» neipnge printer Is an 
applimce which can be. for example, wall-mounted adjvent to an area where die mocning news is first consumed, such as 
in a user's khchen, near a breakfast table, or near the household's point of departure for the day. It also comes in tabletop. 
desktop, portable and miniature versions. 

Netpages printed at their point of consumpdon combine the case-of-usc of paper with the timeliness and 
1 5 inteiacti vity of an tnteracUve medium. 

As shown in Kgure 2, die netpage pen 101 uiteracts with Ok coded dau on a primed netpage 1 and 
comnmnicates. via a short-range radio link 9. the interaction to a netpage printer. The printer 601 sends the inicracaon to 
the relevant netpage page server 1 0 for interpretation. In appropriate circumstances, the page senrer sends a corresponding 
message to application computer software lunniag on a netpage application server 13. The appficatioo server may in turn 
20 send a response which is printed on die origbiating printer. 

Hie netpage system is made considerddy more convenient in dw prefcned embwtiment by being used in 
cotuunction with high-speed microelectromechanlcal system (MEMS) based Inkjet (Mcmjci™) printeis. In the preferred 
form of this technology, relatively high-speed and high-quality printing is made more affordable to consumers. In iu 
preteired form, a netpage publication has the physical cfaancteristics of a traditional newsma«sdne. such as a set of lettcr- 
25 size glossy pages printed in foil color <mbodi sides, bound together for easy navigation and comfortable handling. 

The netpage printer exploits the growing availability of broadband Inlemet access. Cable service is available 
to 95% of households in the United Stales, and cable modem service oliering broadband Internet access is already 
available to 20% of these. The netpage printer can also operate widi slower connections, but with longer delivery times 
and lower image quality. Indeed, the netpage system can be enabled using existing consumer Inkjet and laser printers, 

30 altfiough Ae system wUl operate more slowly and wUI Uierefore be less acceptable &om a consumer's point of view. In 
other embodiments, the netpage system is hosted on a private intranet In still other embodiments, the netpage system is 
hosted on a single oompuler or con^uier-enabled deim, such as a printer. 

Netpage publication stivers 14 on die netpage netwotk are configured to deliver print-quality publications lo 
netpage printers. Periodical publications are delivered automatically to subscribing netpage printers via pointcasting and 

35 naddcKting Inlemet protocols. Personalized publications are filtered and formatted acoonling to individual user profiles. 

A netpage printer can be configured to support any number of pens, arul a pen can work with any nuniber of 
netpage printers. In the preferred implementation, each netpqge pen has a unique identifier. A household may have a 
collection of colored netpage pens, one assigned to each member of die faimly. TUs allows each user to maintain a 
distinct profile with respect to a netpage publication server or application server. 
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A netpa^ pen can also be registered with anctpflgeicgistnttion server 11 and linked lo one or more inyment 
card accountt. This aUows e-commcice payments lo be securely authoriad using the netpage pen. The nctpage 
registration server compares the signature captured by the nctpage pen with a previously regislcred signature, allowing it 
to authenticate the user's identity to an e^ommerce server. Other biometrics can also be used to verify identity. A version 
5 of the neipage pen includes fingerprint scanning, verified in a similar way by the netpagp registration server. 

Although a netpage printer may deliver periodicals such as the morning newspaper without user intervention. 
It can be configured never to dcUvcr unsoUdtcd junk mail. In its preferred form, it only delivers periodicals from 
subscribed or otherwise authorized sources. In this respect, die m^tpage printer is unlike a fox machine or e-maU account 
which is viable lo any junk mailer who knows the telephone nun*cr or emafl address. 

iO 1 Nbtpage System ARCHiTEcnmE 

Each object modd in the system is described using a Unified Modeling Language (UML) class diagram. A 
class diaffun consteis of a set of objert classes connected by relationships, and two kinds of relationships are of interest 
here: assodaiions and gcneializationK. An association represents some land of relaUonship between objects, le. between 
instances of classes. A generalization relates actual classes, and can be understood in the following way: if a class is 

1 5 thought of as the set of aU objects of that dass. and class A is a generalization of class B. then B is simply a subset of A. 
Hie UML does not directly support seoond-oiderniodelling - i.e. classes of classes. 

Eadi class is Aawn as a rectangle labelled with the name of die dass. It contains a list of the attributes of the 
class, separated from the name by a horizontal line, and a Ust of the operations of the class, separated fiom the attribute 
list by a horizontal line, bi the class diagrams which follow, however, operations are never modeUed. 

20 An association is drawn as a line joining two classes, optionally labelled at either end with the muliiplicity of 

the association. The default multiplicity is one. An asterisk (*) indicates a multiplicity of "many*, le. leio or more. Each 
association is optionally labelled vwlh its name, and is also optionally labelled at cither end with the role of *e 
coiresponding dass. An open diamond indicates an aggregation association Cls-pait-of). and is drawn at the aggregator 
end of the assodation Imc. 

25 • A generalization relationship (*is-a'') is drawn as a solid line joining two classes, witii an arrow On the fann 

of an open triangle) at the geaeralization end. 

When a dass diagram is broken up into imiltiple diagrams, any dass which U duplicated is shown with a 
dashed outiine in aU but the nutin diagiam which defines It It is shown with atiribuics only whae U b defined. 

1.1 Nbipages 

30 Nctpages arc the foundation on whidi a netpage neiworit is bu«L They provide a paper-based user interface 

to piiblished infbrmation and interactive services. 

A netpage consists of a printed page (or oUicr surface region) invisibly tagged wiUi references to an online 
description of the page. The online page description is maintained persistently by a netpage page server. The page 
description describes tiie visible Uyout and content of Uie page, including text, graphics and images, it also describes die 
35 input elements on die poge. including buttons, hypcriinks. and input fields. A nctpage allows markings made with a 
netpage pen on iU surface to be sinniltaneously captured and processed by die nctpage system. 

Multiple netpagcs can share die same page description. However, to allow injait through otherwise identical 
pages to be distinguished, each neipage is asagned a unique page identifier. TCs page H) has suffident predsion to 
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distinguisb between a voy large number of netpages. 

Each ftfeicnce lo the page description is encoded in a printed tag* The tag identifies the unique page on 
whidi it appears, and theithy indirectly identifies the page description. The tag also identifies its own position on the 
page. Characteristics of the tags are described in more detail below. 

5 Tags are printed in infrared-absorptive ink on any substrate which is infrared-renective, such as ordinaiy 

paper. Near-infrared wavelengths are invisible to the human but are easily sensed by a solid-state image sensor with 
an appropriate filter. 

A tag is sensed by an area image sensor in the netpage pen. and the tag data is transmitted to the netpage 
system via the nearest netpage printer. The pen is wireless and conununicaies with the netpage printer via a short-range 
1 0 radio linL Tdgs are sufficiently small and densely arranged that the pen can reliably image at least one tag even on a 
single click on the page. It is important dial the pen recognize the page ID and position on every imenciioo with the pag^ 
since the interaction is stateless. Tags ore error-coneciflbly encoded to make them partially tolerant to surface damage. 

The netpage page serva maintains a unique page instance for each printed netpage, allowing it Co maintain a 
disdna set of user^supplied values for input fields in the page description for each printed netpage. 

1 5 The relationship between die page description, the page instance, and the printed netpage b shown in Figure 

4. The printed netpage may be pan of a printed netpage document 45. The page instance is associated with both die 
netpage printer which printed it and, if known, die netpage user who requested it 

12 NEITAGeTACS 
L2a Tag DaU Content 

20 In a preferred form, each tag tdentifies Uie region in which it appears, and the location of that tag wiUiio the 

region. A tag may also contain flags which relate to die region as a whole or to die lag. One or more flag bits may. for 
example, signal a tag sensing device to provide feedback indicative of a function associated with the immediate area of the 
tag. without die sensing device having to refer to a description of the region. A netpage pen may. for example, illuminate 
an "active area'* LED when in the tone of a hyperiink. 

25 As will be more cleariy explained below, in a preferred embodiment, each tag contains an easily recognized 

invariant structure which aids initial detection and which assists In miniinizing die effett of any warp mduoed by the 
surface or by the sensing process. The tags preferably tile the entire page, and are sufficiently small and densely arranged 
Uiat the pen can reliably image at least one tag even on a single dick on the page. U is important diat die pen recognize the 
page ID and position on every inieracdon widi die page, since the interaction is stateless. 

30 In a prefened end>odiment, the region to which a tag refers coincides widi an entire page, and the regioa ID 

encoded in the tag is dierefbre synonymous widi die page ID of die page on which die tag appears. In odier embodiments, 
the region to which a tag refers can be an aibitrary subregion of a page or other surfiice. For example, it ean coincide with 
die zone of an interactive element, in which case the region ID can directly identify the interactive eleornt 



Table 1 - Tag data 



Fldd 


Precision (bits) 


Resion ID 


100 


Tax ID 


16 


Flaxs 


i 
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hTotal 1120 n 

Each lag omtains 120 bits of infonnatton. Q^cally allocated as shown in Table 1. Assundog a nupUimim tag 
density of 64 per square inch, a 16-bit tag ID suppoits a region ^ze of up to 1024 square inches. Larger regions can be 
mapped continuously without increasing (he tag U) precision simply by using abutting regions and maps. The lOO-bit 
5 region ID allows 2*°** (-10* or a million trillion trillion) diffeiau regions to be uniquely identiried. 

1^ Tag Dnia Encoding 

Hk 120 bitt of tag data are redundantly encoded using a (IS, S) Reed-Solomon code. This yields 360 
encoded bits oonsisiing of 6 codewords of 15 4-bit symbols each. Ibe (IS, 5) code allows up to S symbol errafs to be 
ooiTecied per oodewofd, i.e. ii Is tolerant of a ^mbol enor tate of up to 33% per codeword. 

1 0 Each 4-bit symbol is represented In a spatially coherent way in the tag. and the symbols of the six codewords 

are tnterieaved spatially within the tag. lUs ensures that a burst error (an enor affecting multiple spatially adjacent bits) 
damages a minimum number of symbols oveiall and a miiumum number of symbols in any one codeword, thus 
maximi^ng the likelihood dull the burnt entv can be fitUy oonected. 

123 Physical Tag Stnicdire 
15 Hie physical fcpreseniadon of the tag. shown in Figure 5. includes fixed taigec stnicmies IS. 16, 17 and 

variable data areas 18. The fixed target structures allow a sensing device such as the netpage pen to detect the tag and 
infer its three-dimensional orientation relative to die sensor. The data areas contain representations of die individual bits 
of the encoded tag data. 

To achieve proper lag reproduction, (he tag is rendered at aiesolution of 256}<256dots. When pfinied at 1600 
20 dots per inch this yields a tag widi a diameter of about 4 ram. At diis resolution the ttig is designed to be surrounded by a 
**quiet area'' of radius 16 dots. Since die quiet area is also contributed by adjacent tags, it only adds 1 6 dots to the effective 
diameter of die tag. 

Ibe tag inchides six target sCrucOiRS. A detection ring 15 allows die sensing device to Initially detect die tag. 
The ring Is easy to detect because it is lotationally invariant and because a stmple correction of its aspect mio removes 
25 most of the eSccts of perspective distortion. An orientation axis 16 allows the sensing device to determine the 
approximate planar orientation of the tag due to the yaw of the sensor. Hie orientation axis is skewed to yield a unique 
orientadon. Pour perspecdve taigets 17 allow die sensing device to infer an accurate two-£mensional perspective 
transform of the lag and hence an accurate duee-dimensional position and orientation of die tag relaUve to die sensor. 

All target sttucnnes are redundantly targe to improve didr immunity to noise. 

30 The oveiall tag shape is circular. This supports, amongst other things, optimal tag packing on an irregular 

triangular grid. In combination widi the circular detecdon ring, dus makes a circular anangement of data bits within die 
tag optimal To maximiie its size, each data bit is represented by a radial wedge in die foim of an area boimded by two 
radial lines and two concentric circular ares. Each wedge has a minimum <fimen^n of 8 dots at 1600 dpi and is designed 
so diat its base (its inner ore), is at least equal to diis mimmum dimension. The height of die wedge in the radial direction 

35 is always equal to the minimum dimension. Each 4-bit data symbol is represented by an array of 2x2 wedges. 

The IS 4-bit data symbols of each of the six codewords are allocated to the four concentric symbol rings 18a 
to 18d in interleaved fiohion. Symbols are allocated alternately in circular progression around die tag. 
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The inierleaving is designed to maximise the aven^ spaial distance between any two symbols of the same 

codewonL 

In Older Co suppoit **sinele<Uck** interaction with a lagged fegion via a sensing device, the senung device 
must be able to see ai least one entire tag in iu field of view no mancr where in Ac region or at what oriemaiion it is 
5 positioned. Hie lequiied diametei of the field of view of the sensing device is therefore a (unction of the size and spacing 
of Che lags. 

Assunang adicular tag shape, the ndmffluin diameter of Che sensor fidd of view is obtained when che tags 
are tiled on a afuilalefal criangnlar grid, as shown in Figure 6. 

1 ,ZA Tag Image Processing and Decoding 
10 nie tag hnage processing and decoding pcrfemied by a sensing device such as die neipage pen is shown in 

Figure 7. While a captured image is being acquired fitom the image sensor, the dynamic range of the image is determined 

(at 20). The center of the nmge is then chosen as the binary tfweshold for the hnage 21. The image is then thresholded and 

segmented into connected |rixel regions (i.e. shapes 23) (al 21). Shapes which are too small Co represent lag target 

stiuctures are discanled. Hie size and centroid of each shape is also computed. 
15 Binary shape momento 25 are dwn computed (at 24) for each shape, and these provide the basis for 

subsequenUy locating target stniciures. Central shape moments are by their nature invariant of position, and can be easily 

made invariant of scale, aspect ratio and rotation. 

The ring target structure 15 is the first to be located (al 36). A ring has die advantage of being very wcU 

bdiaved when perspective^stofted. Matching proceeds by aspect-normalizing and rotation-norraalizing each shape's 
20 moments. Once its second-oider moments are normaUicd the ring is easy to recognize even if the perspective distortion 

was agnificanL The ring's original aspea and rotation 27 togedier provide a useful approximation of die perspective 

transfonn. 

The axis target structure 16 is die next to be located (at 28). Matching proceeds by applying die ring's 
nonnalizadons to each shape's moments, and rotadon-normalizing die resulting moments. Once its second-order moments 
25 are nonnalized the ajus target is easily recognized. Note that one ttiird order moment is required to disambiguate the two 
possible orientations of Che axis. The shape is deliberately skewed to one side to make this possible. Note also diat it is 
only possible to roCatiorMioniulize die axis target after it has had die ring's normalizations applied, since die perspective 
distortion can hide tkt axis target's axis. The axis target's original rotation provides a useM approximation of die lag's 
rotation due to pen yaw 29. 

30 The four perspective target structures 17 are the last to be located (at 30). Good estimates of dieir positions 

are computed based on their known spatial relationships to the ring and axis tajgcts. die aspect and rotation of die ting, 
and the rotation of die axis. Matching proceeds by applying die ring's normalizations to each shape's moments. Onoe dieir 
second-order moments are normalized die circular perspective targcU are easy to rccotgnize, and die target closest to each 
csUmaled position is taken as a match. The original oentroids of die four perspective targets are Oien taken to be die 

35 perspectiveHfistoited coneis 31 of a square of known size in t^g space, and an elght-^Jegree^-freedoro perspective 
transform 33 is inferred (at 32) bKod on solving the well-understood equations relating die four tag-space and image- 
space point pairs (see Heckbert P., Fundamentals of Texture Ma^iping and Image Warping, Masters Thesis. Dcpt of 
EECS. U. of California at Bericelcy. Technical Report No, UCB/CSD 89/5 16. June 1989, die contents of which are hereiB 
hicorporated by cross-reference}. 
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V» infeired tiig-space to inutge-spacie penpectivc transform is used to project (at 36) each known data bit 
position in lag space into image space wiiere ibe leal-valued position is used to bilinearly interpolate (at 36) the four 
relevant adjacent pixels in the input image. The previously computed image threshold 21 is used to ihieshold the result to 
produce the final bit value 37. 

5 Once all 360 data bits 37 have been obtained m Ibis way, each of the six 60-Wt Reed-S6lomon codewords is 

decoded (at 38) to yield 20 decoded biu 39, or 120 decoded bits in total. Note that the codeword symbols are sampled in 
codeword order, so thai codewords are implicitly de-interleaved during the sampling process. 

The ring tanget IS is only sought in a subarea of the image whose relationship to the image guarantees that the 
ring, if found, is part of a compleie tag. If a oomplece tag is not found and oixessMly decoded, then no pen position is 
10 recorded for the current frame. Given adequate processing power end ideally a non-mlmmal field of view 193, an 
alternative strategy involves seeking another tag in the cuireot image. 

the obtained tag data indicates the identity of the region containing the t^ and the position of the tag within 
the region. An accurate position 3S of the pen nib in (he region, as well as the overall orientation 35 of the pen* is then 
infened (at 34) from the perspective transform 33 observed on dK lag and the known spatial relationship between the 
1 5 pen's physical axis and the pen's opdcal axis. 

I.2.S TagMap 

Decoding a tag results in a region ID, a tag ID, and a mg^relative pen transform. Before the ts^g ID and the 
tag*relati ve pen location can be translated into an absolute location within the tagged region, the location of the tag within 
the region must be known. This is given by a lag map, a function which maps each tag ID in a tagged region to a 
20 conespondlng locaiioo. The tag map class diagram is shown in Figure 22, as pan of the netpage printer class diagram. 

A tag map reflects die scheme used to tile the surface regioQwidi tags, and this can vary according to surface 
^pei When multiple tagged regions share die same tiling scheme and the same tag mimbering scheme, diey can also share 
the same tag map. 

Ihe tag map for a region must be retrievable via the region ID. Thus, given a region ID. a tag ID and a pen 
25 transform, die tag map can be retrieved, the tag ID can be tramlated into an absolute tag h)catioa within the re^on. and 
the tag-relative pen location can be added to the tag location to yield an absolute pen location within the region. 

%M Taggii^ Schemes 

Two distinct surface coding schemes aic of interest. boUi of which use the tag strucmre described eariier in 
this section. Hie prefened coding scheme uses location-mdicadn^ tags as already discussed. An aJtemaiive coding 
30 scheme uses object-indicating tags. 

A location-Indicating tag contains a tag ID which, when translated through the tag map associated with the 
tagged region, yields a unique tag location within die regioit The tag-relattve location of die pen is added to this tag 
location to yield the location of the pen within the region. This in turn is used to determine die location of Uie pen idalive 
CO a user Interface element in the page description associated vnth the region. Not only is die user interfiace element itself 
35 identified, but a location relative to the user interface element is identiliedL Location-indicating tags therefore trivially 
support die capture of an absohite pen path in the zone of a particular user interface dement. 

An object-indicating tag contains a tag ID which directfy Identifies n user interface element in the p^e 
descfiption assodaied with the region. All the tags in die zone of the user interface elemeat identify die user intccfisce 
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element. making (hem ali identical and therefoit indistinguishable. Object-indicating tags do not, therefore, support the 
capture of an absolute pea path. They do, however, support the capture of a relative pen path. So long as the position 
sampling frequency exeeeds twiee the encouoteied tag ftequency^ die displacement ftom one sampled pen position to die 
next vvidun a stroke can be unambiguously delennined. 

5 With eidker tagging scheme, the lags function in coopeialion with associated visual elements on the nctpagc 

as user interactive elements in Uut a user can interact with the pxinted page using an appnopiiate sensing device in order 
for tag dato to be read by die seiishig device and for an appropriate fesponM 

13 OocumektandPacbDssciuftions 

A piefened enbodiment of a document and page desctiption class dtagnun is shown In Figures 25 and 26. 

10 In die netpa^ system a document is desaibed at duee levels. At the most abstract level die document 836 

has a hierarchical structure whose tenzdnal elements 839 aie associated widi contem objects 840 such as text ol^ects. text 
style objects, hnage objects, etc. Once the document Is printed on a printer with a particular page size and according to a 
particular user's scale Atcior ptefeienoe, the documeot is paginated and odierwise formatted Formatted terminal elcmenu 
835 will in some cases be assodaied widi content objects which are diffacat 6om diose associated with their 

15 corresponding teiminal elements, particularly where the content objects are style-related. Each printed instance of a 
document and page is also described separately, to allow input captured duough a particular page instance 830 Id be 
lecoided separately from input captured duough other instances of the same page description. 

The presence of the most abstract document desciiplioa on die page server allows a user to request a copy of 
a document widiout being foiced to accept die source document's specific format. Hie user may be requesting a copy 
20 dirough a printer with a different page size,, for example. Conversely, die presence of die formaited document description 
OQ the page server allows the page server to cfficiendy interpret user actions on a particular primed page. 

A formatted document 834 consists of a sec of formatted page descriptions S. each of which consists of a set 
of fbrmatted terminal elements 835. Each fonnafled element has a spatial extent or zone 58 on the page. Hiis defmes the 
active area of input elemenis such as hyperiuks and input fiehls. 

25 A document instance 831 corresponds to a fomaned document 834. It consists of a set of page instances 830, 

each of which oonesponds to a page description 5 of die formatted document. Each page insianoe 830 describes a single 
unique printed netpage and tecoids the page ID 50 of dienetpage. A page faistance is not pan of a document instance if 
it represents a copy of a page requested in isolation. 

A page instance consists of a set of terminal element instances 832. An etemeot instance only exists if it 
30 necotds uistanoe-specific information. Thus, a hyperlmk instance exists for n hyperlirdc element because it leoonh a 
transaction ID 55 which is specific to the page instance, and a field instance exists for a field element because it records 
input spedfie to the page irutance. An element instance does not exist, however, for static elements such as lextflows. 

A terminal element can be a static element 843t a hypetlink element 844, a field dement 845 or a page server 
command dement 846. as shown in Hgnre 27. A static element 843 can be a style dement 847 widi an associated style 
35 dyject 8S4, a textflow dement 848 with an associated styled text object 8SS, an image element 849 with an associated 
Image element 856, a graphic dement 850 widi an associated graphic object 857. a video dip element 851 widi an 
associated video clip object 858, an audio dip element 852 widi an assodated audio dip object 859. or a script dement 
853 wiUi an assodated script object 860, as shown in Figure 28. 
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Because of pefsonalizaiion, pa^ layouts vt typically specific to a particular sut»criber and so an pointcast to the 
subscriber's pihiter via the appropiiate pags server. Text and image objects, on the other band, are Qrpicalty shared with 
other subscribeis, and so are multicast id a)l subscribers' printers and the appropriaie pa^ serven 

The ndp^ge pubtication server opthnizes the segmentation of document content into poi&leasts and 
5 multicasts. After receiving the pmntcast of a document's page layouts, the printer knows which multicasts, if any, to listen 
to. 

Once the printer has received the complete page layouts and objects thai define the document to be printed, it 
can print the document 

Ihe printer lasterizes and printt odd and even pages siaauitaneously on both sides of the sheet. It contains 
1 0 duplexed print engine oontrolters 760 and print enghies utilizing Meo^et^ prindieads 3 SO for (his purpose. 

The printing process consists of two decoupled stages: lasterizaiion of pJtge descriptions, and expansion and 
printing of page images. The raster image processor (RIP) consists of one or more standard DSPs 157 sunning bi parallet. 
The duplexed print engiae controUen consist of custom processors which expand, dither and prim page hnages in teai 
time, synchroniaed with the operaltoo of the pnniheads in the print engines. 

1 5 Piinteis not enabled Un IR printing have the option to print tags using IR*absoiptive black ink, although this 

restricts lags to odierwise empty areas of the page. Ahhough such pages have moie limited fimcrionality than IR-printed 
pages, ihey arestUl classed as neipeges. 

\ nonnal nctpage printer prints netpages on sheets of paper. Mote specialised netpage printers may print onto 
more specialised surfaces, such as globes. Each printer supports at least one surface type, and suppons at least one tag 
20 tiling scheme; and hence t^ map^ for each surface type. Ihe t^ map 811 which describes the tag Cthng scheme actually 
used to print a document becomes associated wilh that document so that the document's tags can be correctly interpreted. 

Figure 2 shows die netpage pvinter class diagrami, icflectuig prioter-ndatiBd informatiaa maintained by a 
Tegistradon server 11 on du netpage network. 

A piefiuied embodiflKnt of die ncipage printer is described in greater detail 
25 to Figures 11 to 16^ 

l&l Meniietmpjrfittbeaas 

The netpage system can operate using printers made widi a wide range of digital printing technologies, 
including thermal inkjet. piezoelectric inkjet, laser electrophotographic, and others. However, for wide consumer 
acceptance, it is desirable tfut anetpage printer have die following characteristics: 

30 • photographic qnalhyookn'prinring 

• high quality text printing 

• high reliability 

• low printer cost 

• tow ink cost 
35 * iowpapercosi 
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• simple operation 

• neaily sileot printing 

• high printing speed 

• limulianeous double sided priming 
5 * coRipflct fbiin fector 

• low power oonsun^on 

No ooauncfcially available printing technology has all of diese characteristics. 

To cnaiUe to production of printers with these characteristics, the present applicant has invented a new print 
technology, referred to as Memjet^ technology. Memjec^ is a drop^n-demand inkjei technology that Incoiporales 
1 0 pagewiddi priniheads ^ricattd using microelectroisechanlcal systems (MBMS) technology. Figure 17 shows a single 
printing element 300 of a Memjct^ prinihead. The netpage wdlpiinter incorporates 168960 printing elements 300 to 
form a 1600 dpi pagewidth duplex printer. Thit printer simultaneously prints cyan, nu^ta. yellow, black, and infraied 
inks as well as paper conditioner and ink fixative^ 

The printing element 300 is approximately 110 micions long by 32 microns wide. Arrays of these printing 
15 elements are formed on a silicon substiaie 301 that incoipoiaies CMOS logic, data transfer* dming, and drive drcuils Oaot 
^wn). 

Miyor elemenis of the printing element 300 are the nozzle 302. die nozzle rim 303. the nozzle chamber 304» 
the fluidic seal 305, the ink channel rim 306. the lever ann 307. the active actuator beam pair 308. the passive actuator 
beam pair 309. die active acmator anchor 310. die passive actnalor anchor 31 1. and the ink inlet 312. 

20 The active actuator beam pair 308 is mechanically joined to the passive actuator beam pair 309 at the join 

319. Bodi beams pain ate anchored at their respective anchor points 310 and 31 1. Hie combination of elements 308. 309. 
310. 31 1, and 319 form a cantHevered eleetntthennal bend actuator 320. 

Figure 18 shows a small pait of an array of printing elements 300. including a cross secdon 3 15 of a printing 
element 30a Hie cross section 315 is diown without ink. to deariy show die iidc inlet 312 dun passes dirough die sUioon 
25 wafer 301. 

Figures 19(a), 19(b) and 19(c) show the operating cycle of a Memjet^ printing element 300, 

Figure 19(a) shows the quiescent position of die ink meniscus 316 prior to printing an ink droplet. Ink is 
reluned in die nozzle chamber by surfoce tension at die ink meniscus 316 and at die fluidic seal 305 fbnned between die 
nozde chamber 304 and die ink Channel rim 306. 

30 While priming, die prindiead CMOS circuitry distributes data from die prim engine co&ooller to die correct 

printing element, latches die data, and buffers the data to drive die electrodes 31 B of the active actuator beam pair 308. 
This causes an electrical current to pass throu^ die beam pair 308 for about one microsecond, resulting in Joule heating. 
The temperanue increase resulting Irom Joule heating causes die beam pair 308 to expand: As the passive actuator beam 
pair 309 is not heated, it does not expand, resultiqg in a stress difference between die two beam pairs. This stress 

35 difference is partially resolved by die caniileveted end of die decbodiermai bend actuator 320 bending towaids the 
substrate 301. The lever arm 307 transmits diis movement to die nozzle chamber 304. Ibe nozzle chamber 304 moves 
about two nunons to die position shown in Hgure l9Cb). This increases the ink pressure, foiciiig ink 321 out of the nozzle 
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ihc surface of Ihe ncHzle chambei 304. 

A, *e tc^pen^ue of tea» pai. 308 

5 ««Ieclun*eri*«fincdt,il-art«<rfthe«riieei«»l«B«Aen«l«u.316. 

««« 20 slK^ a .f a pHnU««l 3S0. in . ««p.se prime,. a« len^ 
widmcfU«p^(.yplc-iy2.0-»)inU.d,«<*o.35I.The«^*^^^ 
pKn««d). >Vhe« pri-ang. papc, U o^vca pas. a. n«d pnna^^ 
Lugi««dpHnangdea«»300.pri-U«*.ri««*«orW«ofiA 

crrr.r;rrn«.^Me.33i^^™.s««*-^^^ 

^^p„.,«.U»oughU««ri.i«s332«-o-tof««n«d.^l«-«-«n^ 
UiB nozde gwrf U sealed while aie priirter is idle. 

15 M TteNctpwePw . ^;«di«.«nlOl whlch,usingliseiiibeddedc<««iolto 

■n,e active sensing device of 0* neipage sy«em is cyp«a«y « pe« 101. wnicn, «su.g 

p«i.e«.,,«d«»lwi,e..s..,««n*«d«.««P-««<*'-'«^ 
wiA respett ID ihe (known) page siructiire. 

Figure 23 shciiw ihc cwlpagc pen dw» diagfam. relief 

on Ae neipage network. 

^„.id«nibisi«con««wid..ae,«ge.a«pe«deun»ncsiUposiUo.-rfori-««^^ 

page Tl« It Ue- ^ 
page. Tiw niD is au«.uw •clicked' by pressing with the pen 

rib. in oricr 10 «ques.. say. infonnalion bom a netwoilu Funhermore. force « cap 
aUow say. ihe foil dynamiesofasignaliirelobeveiifled. 

1^. pen deunnice. U« poufion am. odenudoo .f iu -ib c. «W 
^.!L':3or-«^.n-.-.-..»r-.n.b.UdecodesU.nea«s.«g».co»^-^^^ 
35 ^U.ugfto«0.obsen«dpersp.c«vedis«,«iono«U..a«gedU«aadU.ekno^ 

rr*. ^ p"*^"" ^ '"""^ •-^'^ 

handwritiitg lecogoition. 

Pe..cdo...da.iv.».ne,»,^«c^«-««-<>''«''-*'«*'^ 
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stamped pen positions on Ihe initialed by a pen-down event and completed by the subse(|uent pen-up event. A stroke 
it also tagged with the page ID SO of the oetpaige whenever the page ID changes, which, under normal ciicumstanoes, is at 
the commenoement of the snoke. 

Each netpage pen has a current selection 826 associated with it, allowing die user to perfbim copy and paste 
5 operations eic The selection is tintestamped to allow the system to discard it after a defined time period. Hie cuntnt 
selectioR describes a legcon of a page instance. Il consists of the most recent digital ink stroke captured through the pen 
relative to the background area of the page. It is interpreted in an application-specific manner once it is submitted to an 
application via a selection hyperlink activation. 

fiachpenhas acuirentnib 824. ITus isthenib last notified by dte pen to the system. In the case of the detaili 
10 netpage pen described above, etdier the marking black ink nib or die non-maiting stylus nib is current Each pen also has 
a current nib style 825. This is the nib style last associated with the pen by an application. e.g. in response to the user 
selecting a color firom a palette. Hie deludt nib style is the nib style associated with the current nib. Strokes captured 
through a pen are tagged widi die current nib style. When die strokes are subsequently reproduced, ttiey are reproduced in 
the nib style with which ttiey are tagged. 

15 Whenever the pen is witlun range of a printer with which it can communicaie, die pen slowly flashes its 

"online*' LED. When the pen fails to decode a stroke relative to the page, it momentarily activates its "enor^ LEO. When 
the pen succeeds in decoding a stroke relative to die p^e.ii momentarily activates its **ok"LEDL 

A sequence of captured strokes is referred to as digital ink. Digital ink forms the basis for the digital exchange 
of drawings and handwriting, for online recognidon of handwriting, and for online verification of signatures. 

20 Hie pen is wireless and U^aasmits digital ink to the netpage printer via a short-range radio link. The 

tiansmined digital ink is encrypted for privacy and security and packedzed for effiaent trassmissioo. but is always fioshed 
on a pciMip event to ensure timely handling in the printer. 

When the pen is out-of-range of a printer it buffers digital ink in internal memoiy. which has a capacity of 
over ten minutes of continuous handwriting. When Ihe pen is once Qgain within range of a printer, it transfers ariy buffered 
25 digital ink. 

A pen can be registered widi any number of printers, but because all state data resides in ndpages bodi on 
paper and on die network, it is largely immaterial which printer a pen is commmicating widi at any particular time. 

A preferredetnbodimentof the pen is described in greater detail in Section 6 bdow, widi reference to Figures 

8 to 10. 

30 1.7 NBTPAOBbrrSRACmON 

The iKtpage printer 601 receives data relating to a stroke ftom die pen 101 when the pen is used to interact 
widi a netpqge 1. The coded data 3 of die tags 4 is read by dw pen when it is used to execute a movement, such as a 
stroke. The data allows the identic of the paiticutar page and associated interactive element to be determined and an 
indication of the relative positiomng of die pen relative to the page to be obtained. The indicaiing data is transmitted to 
35 the printer, where it resolves, via die DNS, die page ID 50 of dm stroke into die network address of die netpage page 
server 10 which maintains die correspondhigpsige instance 830. It dien transmits die stroke to the preserver. If die psige 
was recently identified m an eariier stroke, dien the printer may already have the address of the relevant page server in its 
cache. Each netpage consists of a compact page layout maintained persistently by a netpage page server (see below). The 
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Wh«. me p-ge «v« ««lves OK ,«.Ke ^n. ^ pen. U ««cvcs me page aescrtpUcn .o 
wnni uie p-6 irteraects U is then able to inlerprct the stroke in 

applies. anddctcnmoeswWchcltn^tofthepagedc^^^ ^ 

the contcAt of the type of the lelcvant cIcmenL 

indicated by the lack of response from the pen's **ok" LED. 

kinds of ckmcms i» a W P»8e '•««rtpdo« 
to«gh.fonnfieMe»J» trigger the ««l»-k»rf«a«oei.wdhypertiri^ 



15 



1.74 HypefUnks ««^«-iiaiion andlypicd^ elicits a printed iwpoMe 

A hyperlink i» a me«» of sending « neiMge lo 8 lemoie an)«ic«liM 

inthenetpagcsyHem' 

Afcyperiinkden««844idendfies.hc3pp.ica.oo7,whichhand.cs^va.io„o,*.h^ 

... « I- ..imd" flac whidi «ks the system to include the ufer"* 
which idemifies the hypcriink lo *e appU.-*.. an «l«Hed Oag v*.cb«to J 

^.cadon^.sn,65.».henyperimk««W-«.«-.*«^''-«*^''»-^ 

L«teor.ppe«in«-».e,'.hi««y.Tl«e»»»P«-W'«'«'»««^*^ 

W*e»ah,peril«kis.e.vn»d..hepagese.ersends.«^e««>.nappHc«ionso^^ 

,^^«e^o„isideredh,».ppUc«io„U>«.««i.He.pp.ic«ic.n,i.«solv^ 
L^du».,pesofh,pe.Unks:ge.c™.hyperii«k..afcnnhypeHinksW5.«- 

..,.«30..gene.hyp^e.n^e«....^.--^^ 

selecuon to the appucaiioo. u me vuncu* «„^„« „ a translaiion Into a 

«^n«„g..1«gedoe««em8lvi.gU«««tf*«e«d«g within d««^^ 

ZL.«Ue.e«*hyperii-c«.isd«««eri«d,^wh..i«fi»^ 

The cor^spo^ling hyperlink insumce 862 «conls a tnmsacricn ID 55 whi^ 

e^^.-sl«.ppingc«t"o.pe«Ung^n«in.ain«.b,apo^^ 

Tte^incl«le..hepen-.«mcmselcdto.826ina,eledio„hypc,Unk^^^^^ 
I d^coatenrrjC^rii-slceSeSinaro^hypeHinkacav^^^ 

all hypciiink activations. 

Ahyperiinkedg^-pSdSis.g^elanen. 83. which has -...«H»--H,^^^ 
^ ^ jTth^ngh^ add el-nent in the g.up. the h,p««nk 8M associaUd wid. the » ^ 
. r^I^ ZTe-. be used «, assocUne hyperlink bduvior wi* a field such as a checkbox. I. c *o be n-d. m 

Jlft«be«ed«,.«pporianU.ckbo«d" intention -odd. i^wta^ 
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ftonns 

A fonn dennes a collection of rdated input fields used to capaire a related set of inputs through a printed 
netpage. A fonn allows a user lo suhmit one or more panmeten to an application sottwaie prognun numing on a server. 

A form 867 is a group element 838 in the document liierarcfay. It ultimately oonudns a set of terminal field 
5 dements 839. A form instance 868 represents a printed instance of a form. It consists of a set of field instances 870 which 
conespond to the field elements 845 of the form. Each field instance has an associated value 871. whose type depends on 
the type of the conesponding field dement Each field value records input through a particular printed form instance, ix. 
through one or moie printed neipi^es. Hie form dass diagram is shown in Figure 32. 

Each foim instance has a status 872 which indicates whether the form is active* fro2en, subndtfied. void or 
1 0 expired. A form is active when first printed A fonn becomes frozen once it is signed or once its. freeze time is reached. A 
form becomes submitted oooe one of its subnussion hyperlinks has been activated, unless the hyperiink has its ''submit 
delta" attribute set A form becomes void when the user invokes a void form, reset form or duplicate fonn page command. 
A form expires when its specified expiry time is reached, i.e. when the time the form has been active exceeds the fonm*s 
specified lifetime. While the form is active, form input is allowed Input through a form which is not active is instead 
1 5 captured in die back^ound field 833 of the relevant page instance. When the form is active or frozen, form submission is 
allowed Ariy attempt m submit a form when the form is not active cc frozen is rejected, and instead elicits an form status 
report. 

Each form instance Is associated (at S9) with any fonn instances derived from it, dtus providing a venion 
history, this allows all but the latest version of a form in a particular time period to be excluded from a search. 

20 AU Input Is captured as digital ink. Digital ink 873 consists of a set of dmestamped stroke groups 874^ each of 

which consists of a set of styled strokes 875. Each stroke consisto of a set of timestamped pen positions 876^ eadi of 
which also includes pen orientatioD and nib force. The agital ink class diagram is shown in Figure 33. 

A field element 845 can be a checkbox field 877, a text field 878. a drawing field 879. or a signature field 
880. IHe fieM element class diagram is shown in Figure 34. Any digital ink captured in a field's zone S8 is assigned to die 
25 field 

A checkbox field has an associated boolean value 881. as shown in Figure 35. Any mark (a tick, a crass, a 
stroke, a fill zigzag, etc.) capnired in a checkbox field's zone causes atnie value to be assigned to the field's value. 

A text field has an assodatcd text value 882. as shown in Figure 36. Any digital ink captured hi a text field's 
zone is automatically converted to text via online handwriting recognition, and the text is assigned to the field's vahie. 
30 Online handwriting recognition is well-understood (sec, for exan^Ie, Tappeit, C, C. Y. Suen and T. Wakahara, The State 
of the Art in On-line Handwriting Recognition", lEEB 'nansactions on Pattern Analysis and Machine Intelligence, 
Vol.12, No.8. August 1990. die contents of which are herein incorporated by cross-rcfeicace). 

A signature field has an associated digital signature value 883, as shown in Figure 37. Any digital ink 
caphired in a signaniie field's zone is automatically verified vrith respect lo the identity of the owner of the pen, and a 
35 digital siffuture of die content of die form of whidi the field is part is generated and assigned to die field's value. The 
digital stgnanite is generated using die pen user's private signature key spedTic to the applkation which owns the form. 
Online signanire verificadon Is well-undeisiood (see» for example, Plamondon, R. and G. tocctte, "Automatic Stgnatuie 
Verification and Writer Idendficatioo - Hie State of die ArT, Pattern Recognition, Vol.22, No.2, 1989. die conlenU of 
which are herein incorporated by cross-referBnce). 
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A field dement is hidden if its ^'hidden'* attribute is set A hidden field element does not have an input zone 
on a page and does not accept input, it can have an associated field value which is included in the fonn data when the 
fonn containing the field is submitted. 

"Editing" commands, such as strikothroughs indicating deletion, can also be recognized in foim fields. 

5 Because the handwriting recognition algorithm works "online** (i.e. with access Co the ^namics of Che pen 

movement), rather than ''offline** (ix. with access only to a bitmap of pen markings), it can recognize nm-on discretely- 
written characters with relatively high accuracy, without a writer-dependent training phase. A writer>dependcnt model of 
handwriting is automatically generated over time, however, and can be generated up-firont if necessary. 

Digital ink. as already sUted, consists of a sequence of strokes. Any stroke which staits in a particular 
1 0 demenrs zone is appended to that element's digital ink stream, ready for Inierpfetation. Any stroke not appended Co an 
object's digital ink stream is appended to the background field's digital ink stream. 

Digital ink captured in the background field is interpreted as a selection gesture. Circumscription of one or 
more objects is generally inteipretcd as a selection of the dreumscribed objects, although the actual inteiprctation is 
appUcacion-specifi& 

1 5 Table 2 summarises these various pen interactions with a netpage. 



Table 2 - Smnmaiy of pen interactions with a netpage 



Object 


Type 


Pen Input 


Action 


Hyperlink 


General 


Click 


Submit action (a application 


Form 


Click 


Submit form to application 


Selection 


Click 


Submit selection to application 


FormfieU 


Checkbox 


Any mark 


Assign true to field 


Text 


Handwriting 


Convert digital ink to text; assign text to field 


Drawing 


Digital ink 


Assign digital ink to field 


Signature 


Signature 


Verify digital ink signature; generate digital 
signature of fonn: assign digital signature to field 


^ne 


- 


Circumscription 


Assign digital ink to current selection 



Ihc system maintains a current selection for each pen. The selection consists simply of the most recent stroke 
20 captured in the background field. The selection is cleared alter an inactivity timeout to ensure predictable l)eliavior. 

The raw digital ink captured in every field is retained on the netpage page server and is optionally transmitted 
with the fonn data when the form is submitted to the application. This allows the application to iniem>gate the raw digital 
ink shouU it suqsect the original convcision, sueh as the converaon of handwritten text TMs can, fbr example, involve 
human intervention at the application level for forms which fail certain application-specific consistency checks. As an 
25 extension to this, the entire background area of a form can be designated as a drawing field. The application can then 
decide, on the basis of the presence of digital ink outside the explicit fields of the fomv to route the form to a human 
operator, on the assumption that die user may have incUcated amendments to Ibe fllled-in fields outside of those fields. 

Figure 38 shows a flowchart of the process of handling pen input lelative to a netpage^ Tlie process consisu 
of receiving (at 884) a stroke from the pen; identifying (at 88S) the page instance 830 to which the page ID SO in the 
30 stroke refers; retrieving (at S86) the page description 5; identifying (at 887) a formatted element 839 whose zone 58 the 
stroke intersects; deteindning (at 888) whether the formatted dement corresponds to a field dement, and if so appending 
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(at 892) ihe received stroke to the <Ugttal ink of the field value 871. interpfeting (at 893) Che accumulated digital ink of the 
field, and deterauning (ai 894) whether the field is part of a hyperllnked group 866 and if so activating (at 89S> the 
associated hyperlink; alternatively deteraiintng (ai 889) whether die formatted element conesponds to a hyperlink element 
and if so aaivaiing (at 895) the coiresponding hyperlink; alternatively, in ihc absence of an input field or hyperlink. 
5 appending (at 890) the received stroke to the digital ink of the background field 833; and copying (at 891) the received 
stroke 10 die cunoent selection 826 of the current pen, as maintamed by the tegistration server. 

Figure 38a shows a detailed Howchart of step 893 in die prooess shown in Figure 38. where dw accumulated 
digital ink of a field is interpreted according to die type of the field. The prooess eonsisu of decermining (at 896) whether 
die field is a checkbox and (at 897) whether the digital ink represents a checkmark, and if so assigning (at 898) a true 

1 0 value to the field value: alternatively detennining (at 899) whether die field is a tent field and if so converting (at 900) the 
digital ink to computer text, widi die help of die qipropriaie icgisiTadon server, and assigning (at 901) the converted 
computer text to Ihe field value; alternatively detennining (at 902) whether Ihe field is a signature field and if so verifying 
(at 903) die digital ink as the signature of the pen's owner, with the help of the appropriate registraiton server, creating (at 
904) a digital signature of die contents of die oorrvspoiufing form, also widi the help of die registration server and using 

15 die pen owner's private signamie key fdadag lo die conespondiag applicadon. and assigning (at 905) die digital 
signature to die Geld value. 

1.73 Page Server Commands 

A page server command is a command which is handled locally by die ps^c server. It operates direcdy on 
form, page and document instances. 

20 A page server command 907 can be a void form command 908, a duplicate form command 909, a reset form 

command 910, a get foim siaus command 911, a duplicate page command 912. a reset page command 913. a get page 
stams command 914, a duplicate document conunand 9 IS, a reset H^ifn^nt command 916. or a eet docunsnt status 
command 917, as shown in Figure 39. 

A void form command voids the conespondirig form instance. A duplicate fomi command voids the 
25 corresponding form instaiKe and then produces an active printed copy of die current form instance widi field values 
preserved. The copy contains die same hyperlink transacdon IDs as die original, and so is iDdistinguishid>te ftom die 
original to an application. A reset form command voids the coneaponding form instance and then produces an active 
printed copy of die form instance with field values discarded. A get form status command produces a printed report on the 
status of die cotiesponding form instance, including who publidied it, when it was printed, for whom it was printed, and 
30 die form slams of die form instance. 

Since a form hyperlink instance contains a transaction ID, die application has to be involved in producing a 
new form Instance. A button requesting a new form instance is therefore typically implemented as a hyperlink. 

A duplicate page command produces a printed copy of die oonesponding page instance widi die badcground 
field value preserved. If die page contains a form or is pan of a form, ttien die duplicate page comnand is interpreted as a 
35 duplicate form command. A reset page command produces a printed copy of die contending page instance wilh die 
background field value discarded If die page contains a ft>rm or is pan of a form, dien die reset page command is 
interpreted as a reset form conunand. A get page status command produces a printed report on the status of the 
conresponding p^gc instance, inchiding who published it, when k was printed, for whom it was printed, and die status of 
any forms it contains or is pan of. 
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The netpage logo which appeals on cveiy netp^ge is usually associated with a duplicate page clemenL 

When a page instance is duplicated with field values preserved, field vahies are printed in their native form. 
i.e, a checkmark appears as a standard ch«ckmai1c graphic, and text appears as typeset text. Only drawings and signatures 
appear in their original fomu with a signature accompanied by a standard graphic indicating successful slgnatnie 
5 verification. 

A duplicate document conunand produces a printed copy of the corresponding document instance with 
background field values preserved. If the document contains any fomis, then the duplicate document command duplicates 
the forms in the same way a duplicate form command does. A reset document conamand produces a printed copy of the 
conrespotuUng document instance with background field values discarded. If die documem contains any forms, then die 
1 0 reset document conunand resets the forms in the same way a reset form command does. A gel document stams command 
produces a printed report on the status of die corresponding document instance, including who published it. when it was 
printed, for whom ii was printed, and the status of any forms it contains. 

If Ae page server command's **on selected" attribute is set. then die command operates on the page identiried 
by the pen's current selection rather than on die page containing die commaiid. This allows a menu of page server 
15 commands m be primed. If die target p%e doesn't contdn a page server cominandelemeiii for die designated page server 
command, then the command is ignored 

An application can provide applicadon-spedfic handling by embedding die relevant page server command 
eleinent in a hyperiinked group. The page server activates the hyperiink associated widi die hy^ 
executing (he page server command. 

20 A page server command dement is hidden if its "hidden" attribute is set A hidden command dcnent docs 

not have an input zone on a page and so eannot be activated direcUy by a user. It can. however* be acU vated via a page 
server command endiedded in a differem page, if diat page server eommand has its *'on selected** attribute set 

1.8 STANDARDFfeATURES OF NbXFAGBS 

hk die ptefened fotm, each netpage is printed widi the netpage logo at die bottom to indictte dial it is a 
25 netpage and dierefore has interactive properties, Tlic logo also acts as a copy button. In most cases pressing die logo 
produces a copy of die page. In the case of a form, die button produces a copy of die entire form. And in die case of a 
secure document, such as a dcket or coupon, die bunon elicits an explanatory note or advertising page. 

The deftult single^page copy function is handled directly by die relevant netp^e page server. Special copy 
fiuicdODS ate handled by linking die logo button to an appficadoo. 

30 1^ UskbHelpSysiim 

In a prefened embodiment, die netpage primer has a single button labelled ''Help". When pressed ii elidis a 
single help pagjs 46 of informatioii. inchiding: 

* status of printer eonnecdoD 

* status of printer consumables 
35 . top-level help menu 

* documem function menu 
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• top-level netpage netwoik diiectoiy 

The help menu provides a hienuchlcal manual on how to use the neipage system. 
The document Aancdon menu includes ihe following fimcdoos: 

• print a copy of a document 

• prim a dean copy of a foim 

• print the status of a document 

A document function is initiBted hy selecting the document and then pressiog the button. The status of a 
document indicates who published it and wfaen» to whom it was deliveied. and to whom and when it was subsequently 
submitted as a fonn. 

The help page is obviously unavailable if the printer is unable to print In this case the "oror" light is lit and 
die user can request remote diagnosis over the networiu 

2 PERSONAUZBD PUBUCATION MODBL 

in the following description, news is used as a canonical publication example to ilhistrate pennnalizatlon 
mechanisms in the netpage system. Alihou^ news is often used in die limited sense of newspaper and newsmagazine 
news. Ihe intended scope in the present context is wider. 

In the netpage system, the editorial content and the adveitistng content of a news publication are personalized 
usmg diffeient mechanisms. The editorial content is personalized according to the reader's expKcidy stated and in^idtly 
G^mued interest profile. The advertising oontem is pereonalized according to die reader's locality and demographic. 

2*1 EDrroniAL Pbrsonauzation 

A subscriber can draw on two kinds of news sources: those that deliver news publications, and those that 
deliver news streams. While news publications are aggregated and edited by die publisher, news streams are aggregated 
either by a news publisher or by a spedalized news aggregator. News publications typically correspond to traditional 
newspapers and newsmagazines, while news streams can be many and visied: a "raw" news feed ftom a news service, a 
cartoon strips a freelance wOuts ooluion. a Mend's buUedn boasd, or die reader's own e-maiL 

The netpage publication server supports die publication of edited news publications as well as the 
aggregation of multiple news streams. By handling the aggregation and hence the fotmattmg of news streams selected 
directly by die reader, the server is abk to place advertising on pages over whi^ 

The subscriber builds a daily newspaper by selecting one or more contributing news publications, and 
creating a personalized version of each. The resulting daily editions are printed and bound together into a sii^ 
newspaper. The various members of a household typically express dieir different interests and tastes by sdecUng different 
daily publications and dien customizing diem. 

For each publication, the reader optionally selects speciiic sections. Some sections appear daily, while others 
appear weekly. The daily sections avaifadile from The New Yotk Times online, for example, indude "Page One Plus^ 
••National", "Intemalional". •Opinion". •'Business". •'Aits/Uvin^. Technology'', and "Sports". The set of available 
sections Is specific to a publication, as is die default subset 

The reader can extend the daily newspaper by creating custom sections, each one drawing on any number of 
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news stitaim. Custom secttoiu might be created for e-mail and friends* announcements CPcnonal**), or for monitoring 
news feeds for specific topics (*'Alciu" or Clippings"). 

For each section, the reader optionally specincs its size, either qualitatively <e.g. short, mediunu or long), or 
numeiicaUy (i.e. as a limit on its number of pages), and the desired proportion of advertising, either qualitaUvdy (eg. 
5 high, nofmal, low. none), or numerically G.e. as a peicentiige). 

The reader also optionally expresses a preference for a large number of shorter article* or a small number of 
longer articles. Each article is ideally written (or edited) in both short and bng forms to support this preference. 

An anide may also be written (or edited) in diflferent versions to match the expected sophisiicaUon of die 
reader, for example to provide children's and adults* versions. TTie appn>priate version is selected according to the 
1 0 reader's age. The reader can specify a ''reading age" which takes precedence over their biological age. 

The articles which make up each section are selected and prioritized by the editors^ and each is assigned a 
useful lifetime. By default they are delivered to all relevant subscribers, in priority oider, subject to space constraints in 
die subscribers* editions. 

In sections where it is appropriate, the reader may optionally enable coUaboialive filtering. IWs is then 
1 5 ^ied to articles which have a suffidendy long lifeUme. Eadi article which qualifies for coUabmive filterii« is primed 
witfi rating buttons at the end of die article. The buttons can provide an ea^y choice (e.g. -liked" and "^slikBd'). mddng it 
more likely that readers will bother to rate the article. 

Articles with high priorities and short lifetimes are dierefore effectively coasideTtd essential leading by the 
editors and are delivered to most relevant subscribeis. 

optiooaUy spedfies a serendipity factor, either qualitatively (e.g. do or don't surprise me), or 
numerically. A high serendipity factor lowers the ducshold used for matching during collaborative filtering. A high factor 
makes it more likely dm die coiresponding section wUI be filled to die readers spedfied capacity. A different seremiipity 
fiuxor can be spedfied for diinsrem days of die week. 

Ute reader also optionally specifies topics of particular interest widiin a section, and diis modifies die 
25 priorities assigned by die editors. 

The speed of die reader's Internet connection affects die quality at which images can be ddiveied. Hie leader 
optionally speciHes a preference for fewer images or smaller images or both. If the number or sitt of imaf^ is not 
reduced, dicn images may be ddivered at lower quality (i.c. at lower resolution or wldi greater compression). 

At a global level, du: reader spedfies how quantities, dates, times and monetary values are localized Hus 
30 involves specifying whedier units are imperial or metric, a local timezone and time fonnat. and a local currency, and 
whedier die localization consist of ift «fm translation or annotation. These prefeicnces are derived from the reader's 
locality by default. 

To reduce reading difficulties caused by poor eyesight, die reader optionally spedfies a global preference for 
a larger presentation. Bodi text and images are scaled accordingly, and less information is accommodated on each page. 

35 Tlie lat^qge in whidi a news publication Is published, and Its corresponding text encoding, is a property of 

die publication and not a preference expressed by die user. However, die netpw system can be configured to provide 
automatic translation services in various guises.- 
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U AOVBimsmG L0CALIZATI0NANDTARGE11NG 

Ihe penonalizaiion of the editorial content directly affects the sdveitisiog oonteat, because advenising is 
typically placed to exploit the editorial coniexL Tnvtl 8ds> for example, are more likely to appear In a travel section than 
elsewhere. The value of the editorial content to an advertiser (and therefore to the publisher) lies in its ability to alinct 
5 laige numbers of readers with the right demographics. 

Effective advertising is placed on the basis of locality and demographics. Locality detennincs proximity to 
parUcular services, retailers eic, and particular interests and concerns associated vdth the local community and 
environment. Demographics detennine general interests and preoccupations as well as likely spending patterns. 

A news publisher's most profitable product Is advertising ''space", a multi-diniensional entity detennined by 
10 the publicaiinn's geographic coverage, the size of its leadeiship. its readership demo^hics, and the page area available 
for advertising. 

In the netpage system, the netp^ge publicaikm server computes die approximaie multi-dimensional size of a 
publication's saleable advertising space on a perfection basis, taking into account the publication's geographic coverage, 
the section's readership, die size of each reader's section edition, each reader's advertising proportion, and each reader's 
15 demographic. 

in comparison with other media, the netpage system allows the advertising space to be defined in greater 
detail, and allows smaller pieces of it to be sold separately. It therefore allows it to be sold at closer to its true value. 

Por example, the same advertising "slot** can be sold in varying pn>portions to several advertisers, with 
individual readers' pages randomly receiving the advertisement of one advertiser or another, overall preserving the 
20 proportion of space sold to each advertiser. 

The netpage system allows advertising to t>e linked directly to detailed product information and online 
purchasing. It therefore raises the intrinsic value of the advertising space. 

Because personalization and kKaUzation are handled automatically by netpage pubUeation servers, an 
advertising aggregator can provide art>itrarily broad coverage of both geography and demographics. The subsequent 
25 disaggregaUon is efficient because it is automatic. This makes it more cost-effective for publishers to deal with advenising 
aggregators than to directly capntre advenising. Even though the advertising aggregator is taking a proportion of 
advertising revenue, priflishers may find die change profit-neutral because of the greater effidency of aa^gation. Hie 
advertising aggregator acts as an iniennediafy between advotisers and publishers, and may place the same advertisenient 
in multiple publications. 

30 It is worth noting that ad placement in a netpage publication can be more complex than ad placement in the 

pnblication's traditional counterpart, because the publication's advertising space is more complex. While ignoring the foil 
complexities of negotiations between advertisers, advertising aggregators and publishers, the prderrcd fonn of the netpage 
system provides some automated support for these negotiations, including support for automated auctions of advenising 
space. Automation is particularty desirable for die i^acement of advertisements which generate small amounts of income. 

35 such as small or highly localized advertisements. 

Once placennent has been negotiaied. the aggregator captures and edits the advertisement and reconls It on a 
netpage ad server. Conespoodingly. the publisher records the ad placement on the relevant netpage publtcation server. 
When the netpage publication server lays out each user's perBonalized publication, it picks the relevant advertisements 
from the netpage ad server. 
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23 USERPROflLBS 

Z3.1 InTonnaUon Tiltering 

The pcfsonalization of news and other publications relies on an assoftment of user-specific pioflle 
infbmialion, including: 

5 • publication customizations 

• oollaborative filtering vectors 

• contact details 

• pRsentation prefe re nces 

Hie customizalioa of a publicatioa is typically pubUcation-specilic, and so the custofflization infonoattoo is 
10 maintained by the relevant netpage publication server. 

A collaborative filtering vefctor consists of the user's ratings of a number of news items. It is used to correlate 
different users' interests for the purposes of making recommendations. Although there are benefits to maintaining a single 
collaborative filtering vector independently of any particular publication, there ate two reasons why it is more practical to 
maintain a separate vector for each publication: there is likely to be more overlap between the vectors of subscribexs to the 
1 5 same publication than between those of subscribers lo different publications; and a publication is likely to want to present 
its users' collaborative filtering vecton as part of the value of its brand, not to be found elsewhere. Collaborative filtering 
vectors are thcrefbrealso maintained by the relevant netpage publicatioa server. 

Cbmact details, including name, street address, ZIP Code, state, oountiy. telephone numbers, are global by 
nature, and are maintained by a netpage registration server. 

20 iVesentetion prefcxcnces, inchuling those lor quantities, dates and times, are likewise global and maintained 

in the same way. . 

The localization of advertising relies on the locality indicated in the user^s contact details, while the targeting 
of advertisiug relies on personal information such as date of birth, gender, marital status, income, profession, education, or 
qualitative derivadves such as age range and income range. 

25 For those useis who choose to reveal persona] information for advertising purposes, the information is 

maintained by the relevant netpage registration server. In the absence of such information, advertising can be targeted on 
the basis of the demographic assodated with the user's ZIP or2SP*4 Code. 

Each user, pen, printer, application provider and application is assigned its own unique identifier, and the 
netpage registration server maintains the relationships between them, as shown in Figures 21. 22, 23 and 24. For 
30 registration purposes, a publisher is a special kind of application provider, and a publication is a special kind of 
application. 

Each user 800 may be authorized to use any number of printers 602, and each printer may allow any number 
of users to use iL Bach user has a single default printer (at 66), to which periodical publications are detiveied by de&ult. 
whilst ps^ges printed on demand are deUvered to the printer through which the user is interacting. The server keeps track of 
35 which publishers a user has authorized to print to the user's default printer. A publisher docs not record the ID of any 
particular printer, but instead resolves the lO when it is tequiicd. The user in^y also bo designated as having 
administnitive privileges 69 on the printer, allowing die user to authorize other users to use the printer. TUs only has 



wo 01/03016 



PCT/AUOO/0076S 



•2B- 

meaning if the printer requires administrative privileges 84 lor such operations. 

When a user subscribes 808 to a publication 807. the publisher 806 (i.e. appUcaiion provider 803) is 
authorized to print to a specified printer or the user's default printer. This authorization can be revoked at any time by the 
user. Bach user may have several pens 801 , but a pen is specific to a single user. If a user is authorized to tise a panicttlar 
printer, then that printer recognizes any of Che user's pens. 

The pen ID is used to locale the corresponding user profile niaintained by a particular netpage legistration 
server, via the DNS in the usual way. 

A Web teimioal 809 cao be authorized to print on a particular ne^uige printer, allowing Web pages and 
netpage documentt encountered during Web browsing to be conveniently printed on the neaiest netpage printer. 

The netpage system can colled, on bebidf of a printer provider..fees and oommissions on Income earned 
through publications printed on the provider's printers. Such tncone can include advertismg fees, dick-thiough fees^ e- 
oonuneroe oofflmissions. and transaction fees. If the printer is owned by the user, then the user is the printer provider. 

Each user also has a netpage account 820 which is used to accumulate micro-debits and citdits (such as those 
described in the preceding paragraph); contact details 8 IS, including name, address and telephooe numbers; global 
preferences 816, faicluding privacy, delivery and localizadon seithigs; any number of biometric reooids 817, containing 
the user's encoded signature 818, fingerprint 819 etc; a handwriting model 819 automaticaUy maintained by die system;, 
and SET payment card accounts 821 , with which e-commerce payments can be made. 

In addition to the user-spedtic netpage account, each user also has a netpage account 936 specific to each 
printer the user is authorized to use. Each printer-specific account is used to accumulate micio-debits and oediu related to 
the user's activities on that printer. The user is billed on a regular basis for any outstam&nig debit balances. 

A user optionally appears in die netpage user directory 823, allowing odier users lo locate and direct e-nail 
(etc.) to die user. 

UscrRcglstralkNi 

A number of features of the netpage system operation are predicated on the system's secure knowledge of 
user identity. As discussed hereinabove, this allows the system to, forotample: 

deliver personalized services to individual users independent of location 

support authenticated transactions 

support secure payments 

guarantee a high level of privacy 

In order to udttze the netpage system a person must first become a netpage registered user. In the preferred 
inq>lementation of the present invention, a user must be regtsteicd unth the netpage network, own or be associated with at 
least one registered netpage pen. and be authorized on at least one netpage printer, before being able to meaningfully 
interact widi the netpage network. Registration information for a tiser. including identification information and 
associations between die user and his or her netpage pens and allowed netpage printers, is matntained on die netpage 
networic by a netpage legislation server. The user registration user interface flow is ithistrated in Figure 46 and described 
hsreinbelow 
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Fcr a registraiion of new user, the ncipage system needs to obtain a number of ilems of information, including 
• user identificaiioa iofonnation soch as name, address and contact details, a pen idenUfier for the netpage pen to be 
assodated with die iKw lucr. and a Detpage printer id for die tiew user to 

be initiated through the netpage primer's help page 46, which includes buttons which generate ftgisnation forms for (he 
5 following functions: 

add user 

add pen to usct 

authorize user on printer 

By didcing on die <add usei> button on the help p^ge, a new user registration fonn is produced by the 
10 netpage printer. An example of a user registration form SOO is illusbated in Figure 47. As shown, die user registration 
form includes fields to capture die new user's identic 502, address S04 aid phone details 506, as well as options 508 
concerning privacy considerations for use of the netpage system. Using a netpage pen. the new user enters the appropriate 
details in the defined fields on the user legistiatioo form and clicks the <subfmt> buUon 510 in order lo forward the 
regtstzBCion infonnadon m die netpage registration server, b die preferred unplementmion, the rcgistiation form must be 
15 signed or iniUaied (at 512) by a netpage user widi administrator privileges 69 on the printer before submission. Hie 
registration form also includes a checkbox 514 to indicate that the new user should be given administrator privileges. 

A subset of the users authorized to use a printer are designated as administrators, ntd only diey may auUiorize 
the legislration of additional users and pens on die printer. By default, every new user is an admimsinitor on a particular 
printer until a prinier-spccific privileges setdng 84 is enabled for die printer. Thus, a new ustf can be registered without 
having to be auttiorized by an administrator's pen until the privileges setting is enabled. This sclUng may never be enabled 
in a domestic environment, but may commonly be enabled in a corporate environment. User*spcdfic privileges settings 
only appear on the reglstnaion form If die primer-specific privileges setdng U eniOiled. 

When privileges are enabled, the user registration form naist be audiorized by an adminu^ Ihisis 
done by signing or inidaling die r^stiaiion fonn in the appnipiiate plaee, as mentioned dbove. 

The pen used to submit the registration form, if previously unregistered in Ihe netpage system, is 
automatically linked to die new user. Also, upon registration die new user is automatically audiorized to use the printer 
duough which die r^tralion takes place. Separate registration forms are avaihible dirough die help page to enable a user 
to register anodier pen and/or anodier printer for his or her use, as described heieinbelow. 

As shown in Figure 21, the information obtained by die registration server from the new user via the 
registration form is stored as a netpage user record 800 in die registration server's datable, mdexed by a user ID 60 
allocflied by die r^istntion server to uniquely identity die new netpage user. 

233 Pen Registration 

In order for a user to make full use of die netpage system, he or she must be uniquely associated widi at least 
one netp^ pen or odier netpage interaction deirice. A pen registration process is provided to register a netpage pen for 
use by a rcgistcced netpage user, which b carried out. for example, when die new user registradon process is rpntfmtfd 
witfi a pen registered to another user, or when a user wishes to register anodier pen for his or her own use. The pen 
registration user interface flow is illustrated in Figure 48 and described hcrcinbdow. 

Tlie <add pen to user> button on die help page (at 46 in Figure 48) generates a pen registradon form. This 
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fonn contains name and nickname fields 534, 53S and a <subnut> button S36, as shown in Figure 49. If the fonn is 
requested using a new (previously unregistezed) pen, then the fonn 524 is blank and must be filled out with sufficient 
name details to aUow the netpstge fegistration server to IdenUiy the user. If the form is requested using an existing pen, 
then the form 526 is automatically filled in with the details of the existing pen's owner. 

When the fonn is submitted, the netpage registration serva functions to match the name information against 
the list of local users, ix. users authorized to use the printer through which the registration process is being conducted. 
Partial name infonnatlon can be enteicd. such as just a nidmame. If the name information is ambiguous, the system 
generates a page 528 containing a list 542 of matching users widi an <aild pen> button next to each, as shown in Rguie 
50. The user then simply clicks on the button next to the conect name details on the list with Uie new pen to submit the 
registration request. 

Hie user must submit the pen registration form using the new pen. This links the unique identity of the new 
pen, which is conveyed from the pen to die printer and thenoe to die registration server widi each transmission, to tfie 
identified user. Hie foim cannot be stdxnitted using a pen which is already ivgistered. 

The help page 46 may also include an <add pen to local user> button which, when activated, generates a page 
532 containing a list 548 of all users authorized to use the printer widi an <add pen> button next to each, as shown in 
Figure 51. The local user list is only available to ttiose users with administralor privileges. 

In the evem that privileges for the printer are enabled, die pen registration form must be authorized by an 
admirastrator's pen. This can be done by die administrator signing or initialing die registration form (at 538 In Figmc 49). 

23A Authorize User on Printer 

A user may be audiorized to use additional netpage printers. Once authorized to use a particular prhiter. die 
user may interact widi the printer using any pen linked lo die user. The user audiorization user interface flow is illosirated 
in Figure 52 and described hcrcinbdow. 

The help page 46 contains an <auUkorize user on printer> button which, when activated, generates a user 
audmrization form. This form contains name and nickname fields 564, 565 and a <subDiit> button 566^ as shown in 
Figure 53. If the form is requested using a pen owned by a local user, dien die form 554 is presented blank and must be 
filled out widi sufficient name details to allow die registration server to identify the user to be audiorized for diat printer. 
If die form is requested using a pen belonging to a user not previously audiorized to use die printer, dien die form 556 is 
autmnatically filled in widi die details of die new user, obtahied firom die registration server. 

When the form is submitted, the name information is matched in the negistration server against the global user 
list Partial name information can be emered. such as just a nickname. If the name mformation is ambiguous, the system 
generates a page 558 containing a list 572 of matching users witti an <audtorize uscr> button next to each, as shown in 
Fiput 54. Ihe audiorization request can Oien be submitted by clicking on die button next to die correct name details. 

The help page 46 may also contain an <audiorize global usei> button which, when activated, geneiaies a page 
562 containing a list 578 of all users on die network, widi an <BudiofizB usei> button next to each. The global user list is 
avaibble to all users, bm only contains usen who have elected to appear (e.g. via die user registration form privacy 
options). 

In die event diat privileges for die printer are enabled, die user audiorization form must be audiorized by an 
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adimnistiator's pen. This can be achieved by the administiHtor ugning or initialing the authorization form (at 568 in 
Figure 53). 

The infonnatioD collected in the registratioo/aulhoriaation procedures described herein is maintained in the 
daiabase(s) of the netpage registration server(s) on the netpage netwofk. including the information conceming links 
5 between a user and his or her registered pen(s) and authorized printer(s). This legistration information is then available on 
the oetworic for verification purposes whenever the user performs an action on the netpage networic, or one of the pens 
linked to the user is employed in perfonning an action on the necwori;. 

24 ifrmuGENT Pace Layout 

The netpage publication server automatically lays out the pages of each user's personalized publication on a 
1 0 section-by-section basis. Since most advertisements are In the form of pre-fotmatted rectangles, they are placed on the 
P9ge before the editorial content 

Ihe adveru'sing ratio for a secdon can be achieved widi wildly varying adveitisiog ratios on individual pages 
within the section, and the ad layout algorithm exploits this. The algorithm is configured to attempt to co-locate closely 
tied editorial and advertising content* such as placing ads for roofing material specifically within Ihe publication because 
15 of a special feature on do-it-yourself roofing repairs. 

The editorial ooitfent selected for Ihe user, including text and associated images and graphics, is then laid out 
according to various aesthetic rules. 

The entire process, including the selection of ads and the selection of editorial content, must be iterated once 
die layout has converged, to auempi to more dosely achieve the user's stated section size preference. The section size 
20 preference can. however, be matched on average over time, allowiag significant di^-io-day variations. 

IS DocuMEOT Format 

Once the document is laid out, it is encoded for efficient dsslribution and persistent ston^e on die aetp^ 

network. 

The primary efficiency mechanism is the separation of infonnation specific to a single user*s edition and 
25 iofotmation shared between multiple users' editions. The specific infonnation consisu of the page layout The shared 
infonnation consists of dte olgects to which the page layout refers. Including images, graphics, and pieces of text 

A text object contains ftdly-formaned text represented in the Extensible Markup Language (XML) using the 
Extensible Stylesheet Language (XSL). XSL pfovides precise control over text fbrmattmg independenUy of the region 
into which the text is being set, which in this case is being provided by the layout The text object contains embedded 
30 language codes to enable automatic translatioa, and embedded hyphenation hints to aid with paragraph formatting. 

An image object encodes an image in die JPEG 2000 wavelet-based compressed image format. A graphic 
object encodes a 2D graphic in Scalable Vector Graphics (SVG) fomai. 

The layout itself consists of a series of placed image and graphic objects, linked textflow objects through 
which text objects How, hyperlmks and input fields as described above, and watennark regions. These layout objects are 
35 summarized in Table 3. The layout uses a compaa formal suitable for efficient distribution and storage. 
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TaUe 3 • oetpage layout objects 
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2j$ DocuMDirrDisnuBimiM 

As described above, for purposes of efficient distribution and persistent storage on the netpage network, a 
5 user-specific page layout is separated from the shared objects to which it refers. 

When a subscribed pnblication is ready to be distributed, the netpage publicatioD server allocates, with the 
he^ of the netpage ID server 12» a unique ID for each pa^e. pa^ instance, document, and document instance. 

llie server computes a set of optimized subsets of the shared content and creates a multicast chonnet for each 
subset, and then t^ each uscr-spcdfic layout with the names of the multicast channels which will cany the shared ' 
1 0 content used by that layout The saver then pointcasts each user's layouts to that user's printer via the appropriate page 
server, and uten the poimcasting is complete, multicasts the shared content on the specified channels. After receiving its 
poiMcast, each page server and printer subscribes to the multicast channels specified in the page layouU. Durir^ the 
multicasts, each page server and printer extracts from the multicast streams those objectt referred to by its page layouts. 
The page servers persistently archive the received page layouts and shared content 

15 Once a printer has received all the objects to which its page layouts lefer, the printer re<reates the fully- 

populated layout and then rasterizes and prints it 

Under normal circumstances, the printer prints pages foster than diey can be delivered. Assuming aquancr of 
each page is covered with images, the average page has a size of less than 400KB. The printer can theiefoie hold in excess 
of 100 such pagps in its internal 64MB memory, allovring for temporary buffers etc The printer prinU at a rate of one 
20 page per second. This is equivalent to 400KB or about 3Mbit of page data per second, which is similar to the highest 
expected rate of page data deliveiy over a broadband netwoik. 

Even under abnormal drcumsumoes, such as when the printer runs out of paper, it is likely that the user will 
be able to replenish the paper supply before the printer's tOO-page internal storage c^aaty is exhausted. 

However, if the printer's internal memoiy does fill up. then the printer will be unable to make use of a 
25 multicast when it first occurs. The netpage publication server dierefore altov/s printers to submit requests for rs-muldcasts. 
When a critical number of requests is received or a timeout occurs, the server re*multicasU the oonesponding shaved 
objects. 
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Once a document is printed, a printer can pmduoe an exact duplicate at any time by retrieving its pi^ layouts 
and conteius iiom the relevant page server. 

2.7 On-Demand Documents 

When a netpage document is requested on demand, it can be personalized and delivered in much the same 
5 as a periodical. However* since there is no shared content, delivery is made directly to the requesting printer without 

the use of multicast 

When a non-netpage document is requested on demand, It is not peisonalized. and it is delivered via a 
designated netpaige formatting server which reformats it as a netpage document. A netpage formatting server is a special 
instance of a netpage publication server. The netpage foraiatting server has knowledge of various Internet doGument 
1 0 formats, including Adobe's Foitable Document Format (PDPX and Hypertext Maricup Language (HTML), tn the case of 
HTMU it can make use of the higher resolution of the printed page to present Web pages in a multi-column format, with a 
table of oontenu. It can automatically include all Web pages directly linked to the requested page. Hie user can tune this 
behavior via a pieliMence. 

The neipage formatting server makes standard netpage behavior, including interactivity and persistence, 
1 5 available on any Internet document, no matter what its origin and format It hides knowledge of dlfTerait document 
formats from both the netpage printer and the netpage page server, and hides knowledge of the netpage system fiom Web 
servers. 

3 SecuuiY 

3.1 Crvptografhy 

20 Cryptography is used to protect sensitive information, both in storage and in transit, and to authenticate 

parties to a transaction. There are two classes of ciyptography in widespread use: secret-key cryptography and public-key 
cryptography. The netpsge network uses both classes of oyptograpfay. 

Seciet-kcy cxyptography, also icferred to as symmetrie oyptography, uses the same k^ to encrypt and 
decrypt a message. TWo parties wishing to exchange messages must first anange to securely exchange the secret key. 

25 Pttblic-lcey cryptography, also referred to as asynuneiric cryptography, uses two encryption keys. The two 

keys arc mathematically related io such a way that any message encrypted using one key can only be decrypted using the 
other kqr* One of these keys is then published, while the other is kept private. Ibe public key is used to encrypt any 
message intended for the holder of the private key. Once enoypted using die public key, a message can on|y be decrypted 
using die private key. Thus two parties can securely exchange messages witfiout first having to exchange a secret key. To 

30 ensure dat the private key is secure, it is normal for the holder of the private key to generate the key pair. 

Public-key cryptography can be used to create a digital signature. The holder of the private key can create a 
known hash of a message and dien enoypt the hash usitig the private key. Anyone can then veri^ that die encrypted hash 
constinites the **signamrc'* of the holder of the private key with respect to thai particular message by decrypting the 
encrypted hash using the public key and verifying the hash against the message. If ttie signature is appended to the 
35 message* then Ok recipient of the message can verier both diat die message is genuine and that it has not been altered in 
nansiL 

To make public-key oyptography worit. dm has to be a way to distribute public k^ which prevents 
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impersonation. This is normally done using certificates and certificate authorities. A certificate authority is a misted third 
party which aulhenticates the connection between a public key and someone's identity. The oertificaie authority verifies 
the person's identity by examining identity docaments. and then creates and signs a digita] certificate oont^ning the 
person's identity details and public key. Anyone who tnists the certificate authority can use the public key in the 
5 certiHcate with a high degree of certainty that it is genuine. They just have to verify that (he certificate has indeed been 
signed by the certificate authority, whose public key is well-known. 

In most transaction environments, public-key ciypu>giaphy is only used to create digital signatures and to 
securely eadiange secret session keys. Secret-key cryptogrephy is used for all other purposes. 

In die following discussion, when reference is made to die secure transmission of information between a 
1 0 netpage prinur and a server, what acnialty happens is that the printer obtains the server's certificalc. authenticates it with 
reference u> the certificate authority, uses die public key-exchange key in the certificate to exchange a secret session ksey 
wim die server, and then uses die secret session kor to enciypt the message data. A «es^^ 
arbitniily short lifetime. 

3a NETFAGBPRINTBRSiSCUUTY 

1 5 Each netpage printer is assigned a pair of unique identifiers at time of manufacbire which are stored in read- 

only menioTy in the printer and in die netpage rtgisCration server database. Ihe first ID 62 is public and uniquely identifies 
die printer on die netpage network. The second H) is secret and is used when the printer is first registered on die nelworiL 

When the printer connects to Ute netpage network for die first time after installation, it creates a si^iature 
public/private key pair. It transmits die secret ID and die public key securely lo the netpage r^jsiiaUon server. The server 
20 compares die secret ID against die printer's secret ID recorded in its database, and accepts die rcgisnadon if the IDs 
match. It dien creates and signs a certificate containing die piinler's public ID and public signature key. and stores die 
oertificaie in die registration database. 

Hie netpage registraiioo server acu as a certifuate auttiority for netpage printers, since it has access to secret 
infoimadoo aOowuig it to verify printer identity. 

25 When a user subscribes to a publicalk>n» a record is created in the netpage registntion sctver database 

auOiorizing die publisher to print die publicaUon to die user's default printer or a specified printer. Evciy document sent 
to a printer via a page senrer is addressed to a particular user and is signed by die publisher using die publisher's private 
signature key. The page server verifies, via the registration database, dm die publisher is aidtoriied lo deliver die 
pubUcation to die specified user. The page server verifies the signature using die publisher's pubUc key, obtahied from die 

30 publisher's certificate stored m die registration database. 

The netpage registration server accepts requeste to add printing audioiizations to die database, so long as 
diose requests are initiated viaapen registered to the printer. 

U NmAGBPENSECURmr 

Each netpage pen is assigned a unique ideadfier at time of manufacmre which is stored in read-only memory 
35 in die pea and in die netpage registiadon server database. The pen ID 61 uniquely idemifies die pen on die netpage 
network. 

A netpage pen can "know" a number of netpage printers, and a primer can Itnow" a number of pens. A pen 
communicates widi a printer via a radio frequency signal whenever it is within range of die printer. Once a pen and printer 



wo 01/03016 



PCT/AUOO/00765 



.35. 

are registered. Ihcy regularly exchange session keys. Whenever the pen transmits digital ink to the printer, the digital ink 
is always encrypted using the appropriate session key. Digital ink is never transmitted in the clear. 

A pen stoics a session key for every printer it knows, indexed by printer ID, and a printer stores a session key 
for tmy pen it knows, indexed by pen ID. Both have a laige but finite stor^e capacity for session keys, and wiU for^ a 
session key on a least-iecenllyHised hasb if necessary. 

When a pen comes within range of a prints, the pen and printer discover whether they know each other. If 
they don't know each other, then ttie printer detennines whether it is supposed to know the pen. This might be, for 
example, because the pen belongs to a user who is regisiered to use the printer. If the printer is meant to know the pen but 
doesn't, then It initiates the automalk pen registration procedure. If the printer tsn*t meant to know the pen, Chen it agrees 
widi die pen to ignore it until the pen is placed in a diaiging cup^ at which time it initiates the legistrBiion pfoocdurc. 

In addition to its public ID. the pen contains a secret kcy-cxchange key. The key-exchange key is also 
recorded in the nctpage registration server database at time of manulacturc. During registration* die pen transmits its pen 
ID to die primer, and die printer transmils die pen ID to the netpageregistradon server. The server geoentes a session key 
for the printer and pen to use. and securely transmits die session key to the printer. It also transmits a copy of the session 
key encrypted with the pen's key-exchange key. The printer stores die session key internally, faidexed by die pen ID, and 
transmits die encrypted session key to the pen. The pen stores the session key internally, indexed by Uie printer ID. 

AldMMigh a fake pen can impersonate a pen in die pen registration protocol, only a real pen can decrypt die 
session key transmilted by the printer. 

When a previously unregistered pen Is first registered, it is of limited use until it Is linked to a user. A 
registered but 'Hin^wned" pen is only allowed to be used to request and fill m netpage user and pen registration forms, to 
register a new user to which die new pen is automatically linked, or to add a new pen to an existing user. 

The pen uses secret-key radier than public-key encryption because of hardware performance oonstiaints in die 

pen. 

3.4 Sbcixrb Documents 

Hie netpage system supporU die delivery of secure documenU such as tickeU and coupons. The netps^c 
printer includes a fodlity to print watennaiks. but will only do so on request from publishers who are suitably authoriied. 
The publisher indicates its auUiority to print watermarks in its ceitificate, which the printer is able to authenticate. 

The *'WBteiinarit" printing process nses on alternative diOer mavix in specified 'Vaiernaric" regions of die 
P4ge. Back-lo4>ack pages contain nurrorHomge watermark regions which coincide when printed. The dither matrices used 
in odd and even pages' watermark regions are designed to produce an interference eflect when die regions are viewed 
togedier, achieved by looking thnmgh die printed sheet 

The effect is sinular to a watermaifc in diat it U not visible when looluqg at only one side of the p^e. ^ 
lost when the page is copied by normal means. 

Pages of secure documents cannot be copied using die built-in netpage copy mechanism desciibed in Section 
1 .9 above. This extends to copying netp^es on netpage-aware photoccq^era. 

Secure documents are lypicaUy generated as part of e-commerce Cransacdons. They can tfierefore include die 
user^s photograph which was capnued when the user registered biometric information widi die netpage negistrttion server, 
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as described in Section 2. 

When presented with a secnre necpage docomcnt, the tecipient can verify its authenticity by requesting its 
status in the usual way. The unique ID of a secure document is only valid for the lifetime of the docunnent, and secure 
document IDs are allocated non-contigoously to prevent their prediction by oppoitunlslic forgere. A secure document 
5 verifkatian pen can be developed wifli built-in feedback on verification failure, to support easy poinl-of-piesentation 
document verification. 

Clearly neither the watermark nor the user's photograph are secure in a cryptographic sense, lliey simply 
provide a sagniftcant obstacle to casual forgery. Online document verificatioiu particidariy using a verification pen, 
provides an added level of security where it is need^ but is still not entirely imnune to forgeries. 

10 3.5 Non-Rkpudiation 

In the neipage system* fonns subndaed by users are delivered reliaUy to forms handlers and are persistently 
archived on netpi^ pqge servers. It is therefore impossible for recipients to repudiate delivery. 

B-commerce payments made thit»agh the ^stem. as described in Section 4, are also impossible for die payee 

to repudiate. 

15 4 Electronic CdMMERCB Model 

4.1 SKCURB ELBCIRONIC TkANSACTION (SET) 

The netpage system uses the Secure Electronic Transaction (SET) system as one of its payment systems. SET, 
having been developed by MasterCard and Visa, is organized aiound paynsent caids. and this is reflected in the 
tennmology. However, much of die system is independent of the type of accounts being used. 

20 In SET, cardholders and merehams register with a certiHcaie autliority and are issued with certificates 

containing their public signature keys. The certificate authority verifies a cardholder's registration details with the card 
issuer as appropriate, and verifies a merchant's registration details with the acquirer as appropriate. Cardholders and 
merchants store their respective private signature keys securely on their computers. [>uring the payment process, these 
certificates are used to mutually authenticate a merchant and cardholder, and to audienticaie them both to the payment 

25 gateway. 

SET has not yet been adopted widely, partly because cardholder maintenance of keys and certificates is 
considered burdensome. Interim solutions which maintain cardholder keys and oerttficaies on a server and give the 
cardholder access via a password have met with some success. 

4.2 SET Payments 

30 In the netpage system the netpage registration server acts as a proxy for the netpage user (Le. the cardholder) 

in SET pqrment transactions. 

The netpage system uses biometrics to authenticate the user and authorize SET payments. Because the system 
is pen-based, the biometric used is the user* s on-line signature, consisting of time-varying pen position and pressure. A 
fingerprint biometric can also be used by designing a fingerprint sensor into the pen, although at a higher cost The type of 
35 biometric used only affects the capture of the biometric, not die authorization aspects of the system. 

The first step lo being able to make SET pi^meats is to register the user's biometric with die netps^ 
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regtstration server. This is done in a controlled environment, for example a bank, where the biometric can be captured at 
the same time as the user's identity is verified. The biometric is captured and stored in the legistratioD database, linked to 
the user's reooid The user's photograph is also optionally captured and linked to the record. The SET caidholder 
registration process is completed, and the resulting private signature key and certificate are stored in the database. The 
user's payment card tnronnation is also stored, giving the neipage registration server enoughjnfonnation to act as the 
user's pfoxy in any SET payment fiansactioa 

When the user evennially supplies the biometric to complete a payment, for example by signing a netpage 
order fbcm, the printer securely transmits the order infonnation. the pen ID and the biometiic data to the netpage 
registration server. The server verifies die biometric with respea to the user identified by the pen ID, and from then on 
acts as the user's proxy in completing the SET paymem transaction. 

43 MlCKO-PAYMEfOS 

Ihe netpage system includes a mechanism for micro-payments, to allow the user to be conveniently charged 
for printing low-cost documents on demand and for copying copyright documents, and possibly also to allow die user to 
be reimbursed for expenses incurred in printing advertising material. The tatter depends on Ihe level of subsidy abeady 
provided to the user. 

When Ihe user legistcrs for e^commercc, a network account is established which aggregates micro-payments. 
The user receives a statement on a regular basis, and can setde any outstanding debit balance using the standard payment 
medianism. 

Ihe network account can bo extended to aggregate subscription fees for periodicals, which would also 
otherwise be presented to the user in the form of individual statements. 

4A Transactions 

When a user requests a netpage in a particular application context, the application is aMe to embed a user- 
specific transaction ID SS in the page. Subsequent input duough Ihe page is tagged with the transaction ID. and the 
application is dtereby able to cstabfish an appropriate context for die user's input. 

When input occurs through a page which is not user-specific, however, the application must use the user's 
unique ideiuity to esuiblish a context. A typical example involves adding items from a pie-iirinted catalog page to the 
user's virtual "shopping cart". To protect the user's privacy, however, the unique user ID 60 known to the netp^e system 
is not divulged to applications. This is to prevent different application providers from easily condating independently 
accumulated behavioral data. 

The netpage registration server instead maintains an aaonymous relationship between a user and an 
application via a unique alias ID 65. as shown in Figure 24. Whenever the user activates a hyperiink tagged with the 
"registered" attribute, the netpage page server asks die netpage registrarion server to translate the associated applicadon 
ID M, togedier with the pen ID 61, into an alias ID 6S. The alias ID is then subnutted to die hyperlink's application. • 

The appiicatian maintains slate information indexed by alias ID. and is able to retrieve user-spedfic Slate 
information widuMit knowledge of dse gtobal identity of dw user. 

The system also maintains an independeol certificate and private slgnamre key for each of a user's 
applications, to aUow it to sign application transactions on behalf of die user using only qiplication-specific informadon. 
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To assist the system in muting product bar code (UPQ "Kyperlink" activations, the system reeofds a fevorile 
application on behalf of the user for any number of product types. 

Each application is associated with an application provider, and the system maintains an account on behalf of 
each application provider, to allow it to credit and debit the provider for dick-duough fees etc. 

5 An application provider can be a publisher of periodical subscribed coatem. The system recoids the user's 

willingness to receive die subscribed publication, as well as the expected frequency of publicatioa 

5 Communications Protocols 

A communications protocd defines an oideitd exchange of mess^ between entities, in the netpage system, 
entities such as pens, printers and serven utilise a set of defined protocols lo coopetatively handle user interactkm with 
10 the netpage system. 

Each protocol is illustrated by way of a sequence diagram in which the horizontal dimension is used to 
represent message flow and die vertical dimension is used to represent time. Each entity is lepresented by a icctangle 
containing the name of the entity and a vertical column representing die lifeline of the entity. During the time an entity 
exists, die lifeline is shown as a dashed line. During the time an entity is active, die lifeline is shown as a double line. 
1 5 Because die protocols considered here do not create or destroy entities, lifelines are geneiaUy cut short as soon as an 
entity ceases to participate in a protocol. 

5.1 SuBSCRirnoNDEijvERY Protocol 

A prefened embodiment of a subscription delivery protocol is shown in Figure 40. 

A large number of usen may subscribe to a periodical publication. Each user's edition may be Imd out 
20 difTerendy, but many users* editions will share common content such as text objects and image objccU. The subscription 
deliveiy protocol therefore delivers document stiucnires to individual printers via pointcast, biu delivers shared content 
objects via multicast 

Hie application (i.e. publisher) first obtain a documem ID 51 for each document fiom an ID server 12. It 
then sends each document structure, including its documem ID and page descriptions^ to the page sefver 10 responsible 
25 for die docmnent's newly aUocated ID. It includes its own application ID 64. die subscriber's alias ID 65. and dw relevant 
* set of multicast channel names. It signs the message using its private signanire key. 

The page server uses the application ID and alias ID to obtain from the registration server die corresponding 
user ID 60. die user's selected printer ID 62 (which may be expliddy selected for die ^plic^on. ormay be die user's 
default printer), and die application's ceitiflcate. 

30 The application's certificaie allows the page server to verify Uie message signature. The page server's request 

to the registration server fails if the application ID and alias CD don't together identify a subscription 808. 

The page server dien allocates document and page instance IDs and forwards die page descriptions, including 
page IDs SO. to die printer. It includes die relevant set of multicast channel names for die primer to listen to. 

It dien returns the newly allocated page IDs to die applieation for fohue reference. 

35 Once die application has distributed all of die docianent structures to die subscribers' selected printers via die 

relevant page servers, it multicasts die various subsets of Uie shared objects on tfie previously selected mt>iHr ii«> channels. 
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Botb piffi servers and printers monitor the appiopriote multicast channels and receive their required content objects. They 
are then able to populate the previously poinicast document stnictures. This allows the page servers to add complete 
documents to their databases, and it allows the printeis to print the documents. 

5^ HVPBIIUNKACnVAnONPkOTOCOL 

A prefened embodiment of a hyperlink activation piotoool is shown in Figure 42. 

When a user clicks on a netpage with a nctpage pen, the pen communicates the click to the oeaiesl nctpage 
printer 601. Ibe dick idenUBes the page and a locaiiott on the page. Tlie printer al^^ ofthepenftom 
the pen connection protocol. 

The printer determines, via the DNS. the network address of the page server lOa handling the particular page 
ID SO. The address may already be in its cache if the user has recently interacted with the same page. The primer then 
fixwaids the pen ID. iU own primer ED 62. the page ID and dick location to dw page server. 

Hie page server toads the page description S identified by the page ID and determines which input demcnt's 
zone 58, if any, the dick lies in. Assuming the relevant input element is a hypcrUnk clement 844, the page server then 
obtains die associated application ID 64 and link S) 54. and determines, via the DNS. die network address of the 
application server hosting the application 7 1. 

The page server uses the pen ID 61 to obtain the corresponding user ID 60 from the leglsmtion server 11. 
and then allocates a globally unique hyperiink request ID S2 and builds a hyperiink request 934. The hyperiink lequest 
dass diagram is shown in Figure 41. The hyperlink request records the IDs of the requesting user and printer, and 
Identifies the clicked hyperlink instance 862. The page server dien sends its own server ID 53. the hyperlink nsquest ID. 
and the link ID to the applicatton. 

Hie application produces a response documem aooording to applicadon-spedfic li^ and obtains a 
documem ID 51 from an ID server 12. It then sends the documem to the page server lOb responsible for the document's 
newly diocated ID. together with the requesting page server's ID and the hyperlink request ID. 

The second page server sends the hyperlink request ID and application ID to the first page server to obtain the 
ooiresponding user ID and printer ID 62. The first p^ server rejects the request if the h 
for a diffeieat api^ication. 

The second page server allocates document instance and page IDs 50. returns the newly diocaled page IDs to 
the application, adds the complete document to its own database, and lindly sends the descriptions to the lequestit^ 
printer. 

Tlie hyperiink instance may indude a meaningfkU transaction ID 55, in which case die fint page server 
indudes the transaction ID in die message sent to the application. This allows die appUcaiion to establish a trans^on- 
specific context for the hyperiink activadon. 

If the hyperlink requires a user alias, i.e. iu "alias required" attribute is set, then die first page server sends 
boUi die pen ID 61 and die hyperiink*8 application ID 64 to die registration server 11 to obtain not just die user ID 
corresponding to die pen ID but also die dias ID 65 corresponding to the application ID and die user ID. It indudes the 
alias ID in die message sent to tile application, allowing die application to establish a user<spedfic ooniext for the 
hyperlink activation. 
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53 Handwutoig R£COGNmoK Protocol 

When a user draws a stroke on a netpag^ with anetp^ pea. the pen oominunicatcs the stroke to the nearest 
netpage printer. The stroke identifies the page and a path oa the page. 

Ihe printer forwards the pen ID 61. tu own primer ID 62. the page ID SO and stroke path to die page server 
10 in the usual way. 

The page server loads the page description 5 identified by the page ID and detennines which input elemeot's 
zone 58, if any, the stroke intersects. Assuming the relevant input dement is a text field S78, the page server appends the 
stroke to die text Iteld's digitd ink. 

After a period of inactivi^ in die aone of the text field, the page server sends the pen ID and the pending 
strokes to die registnOion server 1 1 for interpretation. The registration server identifies the user corresponding to the pen, 
and uses the user's accumulated handwriting mode) 822 to interpret the strokes as handwritten texL Once it has converted 
the strokes Id text, the registration server returns the text to the requesting page server. The page server appends the text to 
the text value of the lexi field. 

5 A SiGNATim Vkaification PROrrOGOL 

Assumir^ die input ekinent whose zone the stroke intersects is a signature field 880. the page server 10 
appends the stroke to the signature field's digital ink. 

After a period of inactivity in the zone of the signature field, the page server sends the pen ID 61 and the 
pending strokes to the registration server 1 1 for verification. It also sends the application ID 64 associated with the form 
of which die signature field is part, as well as the tbtm ID 56 and die current data content of die form. The registration 
server identifies the user corresponding to the pen. and uses the user's dynamic signature biometric 818 to verify the 
strokes as the user's signature: Onoe it has verified die signature, die registration server uses die application U> 64 and 
user ID 60 to identify die user's application^specific private signature key. It then uses die key to generate a digital 
signahire of the form data, and returns die digital signature to Hie requesting page server. The page server assigns die 
digital signature to die signature field and sets die associated fonn's status to Frozen. 

The digital signature includes die alias ID 65 of the corresponding user. This allows a single form to capture 
multiple users' signatures. 

53 Form Submission Protocol 

A preferred embodiment of a form submission protocol is shown in Figure 43. 

Form submission occurs via a form hyperlink activation. It thus follows Uie proCocol defined in Section S.2. 
widi some form-specific additions. 

In die case of a form hyperlink, die hyperlink activation message sent by die page server 10 to the application 
71 also contains die form ID 56 and die cunent data content of the fona If the foim contains any signature fields, then the 
application verifies each one by extracting die alias ID 65 associated widi the coneapondiQg dlgjbal signanue and 
obtaining die corresponding certificate from die registration server 11. 



wo 01/03016 



PCT/AUOO/00765 



•41- 

6 Nbtpags Pen Description 

4K.1 Pen Mechanics 

Refenriqg to Flgutes 8 and 9. the pen, generally designated by reference numeral 101, Includes a housing 102 
in (he form of a plastics nxwlding having walls 103 defining an interior space 104 for mounting the pen components. The 
5 pen top 105 is in operation rotatably mounted at one end 106 of the housing 102. A semi-transparent cover 107 is secured 
to the qiposite end 108 of the housing 102. The cover 107 is also of moulded plastics* and is formed from semi> 
traospaicot material in order to enable the user to view the status of the LED mounted within the housing 102. The cover 
107 includes a main part 109 which substantially surrounds the end 108 of the housing 102 and a projecting poition 1 10 
which projects back from the main part 109 and fits within a corresponding slot 111 fonned in die walls 103 of the 
1 0 housing 102. A radio antenna 1 12 is mounted behind the projecting portion 1 10, within the housing 102. Screw threads 
113 sunounding an aperture 113A on the cover 107 are airanged to rocdve a metal end piece 114, including 
corresponding screw threads 1 15. Hie metal end piece 1 14 is removable to enable ink camidge replacement. 

Also mounted widiin the cover 107 is a tii*color status LED 116 on a Oca PCB 1 17. The antenna 1 12 is also 
mounted on the flex PCB 117. The status LED 1 16 is mounted at the top of die pen 101 for good all-aiound visibility. 

15 Tlie pen can operate both as a normal inarldng ink pen and as a noo-markiiig stylus. An ink pe^ 118 

with nib 1 19 and a stylus 120 witfi stylus nib 121 are mounted side by side within the housing 102. Either the ink 
cartridge nib 119 or the stylus nib 121 can be brought forward through open end 122 of the metal end piece 1 14. by 
rotation of die pen top 105. Respective slider blocks 123 and 124 are mounted to the ink cartridge 118 and stylus 120. 
respectively. A rotataUe cam banel 125 is secured to Um pen top 105 in operation and arranged to rotate therewith. The 

20 cam bairel 125 ineludes a cam 126 in the form of a slot within the walls 181 of the cam band. Cam followers 127 and 
128 projecting from slider blocks 123 and 124 fit widiin the cam slot 126. On rotation of the cam barrel 125, die slider 
blocks 123 or 1 24 opve relative to each odier to project either the pen nib 1 19 or s^lus nib 12 1 out dirough the hole 1 22 
in the metal end piece 114. The pen 101 has three slates of operation. By turning the top 105 Ounough 90* sleps» the three 
states arc: 

25 • Stylus 120nib 121 out; 

• Ink cartridge 1 18 nib 1 19 out; and 

• Neidier ink cartridge II S nib 1 19 out nor stylus 120 nib 121 out 

A second flex PCB 129. is mounted on an electronics chassis 130 which sits widiin die housing 102. The 
second flex PCB 129 mounts an inirered LED 131 for providing infrared radiation for projection onto the sutface. An 

30 image sensor 1 32 is provided mounted on the second flex PCB 129 for receiving reflected iwlialion from the surface. The 
second Ilex PCB 129 also mounts a radio finquency chip 133, which includes an RF transmitter and RF receiver, and a 
controller chip 134 for controlling operation of die pen 101. An optics block 135 (formed from moulded clear plastics) 
sits within the cover 107 and projects an infrared beam onto the surfrux and receives images onto die image sensor 132. 
Power supply wires 136 connect die coinponenU on the second flea PCB 129 to battery contacts 137 which are mounted 

35 within the cam barrel 125. A tenninal 138 connects to die battery contacts 137 and die cam barrel 125. A diree volt 
rechargeable battery 139 sits within the cam barrel 125 in contact with the battery contacts. An induction charging coil 
140 is mounted about die second flex PCB 129 to enable recharging of die battery 139 via induction. The second flex 
PCB 129 also mounts an infrared LED 143 and Infrared photodioda 144 for detectmg displacement in die cam band 125 
when eidier die stylus 120 or die ink cartridge 1 18 is used for writing, in order lo enable a determination of die force * 
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being applied to the smfacc by the pen nib 1 19 or stylus nib 121. Hie IR photodiode 144 delects light from the IR LED 
143 via relleclois (not shown) mounted on the slider blocks 123 and 124. 

Rubber grip pads 141 and 142 are provided tourards the end 108 of the housing 102 to assist gripping the pen 
101, and top 105 also includes a clip 142 for clipping the pen 101 to a pocket 

5 6a PenContboulbr 

The pen 101 is arranged to detennme the positioo of its nib (stylus nib 121 or ink caitridge nib 1 19} by 
imping, in die infrared spectnun, an area of die surface in the vicinity of the nib. It icooids the location data from die 
nearest location tag. and is arranged to calculate the distance of the nib 121 or 1 19 from the location tab utilising optics 
13S and controller chip 134. The controller chip 134 calculates die orientadon of die pen and die nib-to-tag distance from 
10 die perspective distortion observed on the imaged tag. 

Utilising die RF chip 133 and antenna 112 die pen 101 can transmit die digital ink data (which is encrypted 
(or securi^ and packaged for efficient transmission) to die computing system. 

When die pen is in range of a icceiver, die digital ink data is transmitted as it is formed When Che pen 101 
moves out of range, digital ink data is bulTeied wiUiin die pen 101 (die pen 101 circuitry includes a buffer arranged to 
15 store digital ink data for approximaiely 12 minutes of die pen motion on die surto) and can be liansnntted later. 

The controller chip 134 is mounted ori die second Hex KB 129 in die pen 101. Rgure 10 is a block diagram 
illustrating in more detail die architecture of die controUer chip 134. Ttguie 10 also shows ftpresentations of die RF chip 
133. die image sensor 132. die tri-color status LED lltii die IR illumination LED 131, die IR force sensor LBD 143. and 
die force sensor photodiode 144. 

20 Hie pen controller chip 134 includes a controlling processor 14S. Bus 146 enables die exchange of data 

between components of die controller chip 134. Flash memory 147 and a 512 KB DRAM 148 are also included. An 
analog^o-digital converter 149 is arranged to convert die analog signal from die force sensor photodiode 144 to a digital 
signal. 

An image sensor interface IS2 inteifrices widi die image sensor 132. A transceiver controller 153 and base 
25 band circuit 154 aiv also included to hiterfrioe widi die RF chip 133 which includes an RF circuit 155 and RF rcsonaiOR 
and inducton 156 connected to die antenna 112. 

The controlling processor 145 captures and decodes k>cadon data from tags from die surface via the image 
sensor 132, monitors die forac sensor photodiode 144. controls die LEDs 116. 131 and 143, and handles short-range radio 
communication via die radio transceiver 153. It is a medhun-performance (-40MHz) general-purpose RISC processor. 

30 The processor 145. digital transceiver components (transoeiver controller 153 and basdiand dioiit 154). 

image sensor interface 152« flash memoiy 147 and 512KB DRAM 14B are integrated in a single controller ASIC Analog 
RF components (RP ciroiit 15S and RF resonators and inductors 156) are provided in die separate RFchip. 

The image sensor is a 215x215 pixel CCD (such a sensor is produced by Matsushita Electronic Corporation, 
and is described in a paper by Itakura, K T Nobusado. N Qtcusenya. R Nagayoshi. and M Ozaki, "A Irom 50k'Pixel IT 
35 CCD Image Sensor for Miniature Camera System**. IEEE Transactions on Etecnonie Devices, Volt 47. nuniber I . January 
2000. which is incorporated herein by reference) widi an IR rdter. 

The controUer ASIC 134 enters a <|uieaoent state after a period of inactivity when die pen 101 is not in 
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oontaa with a surface. It tnoorporates a dedicated circuit ISO whidi monitofs the force sensor photodiode 144 and wakes 
up the eontnoller 134 via the power manager 1 51 on a pen-down event 

Ihc radio transceiver oomniunicates in the unlicensed 900MHz band noraaally used hy cordless telephones, 
or aiteniatively in the unlicensed 24Qllx industrial, scientific and medical (ISM) band, and uses fiequency hopping »d 
5 collision detection lo piovide Imerfeience-ftee communicailon. 

bi an altemativc embodiment, the pen incorporates an Infrared Data Association (IrDA) interface for shoit- 
range oonununication with a base station or netpage printer. 

In a further embodinient, the pen 101 includes a pair of orthogonal accelerometers mounted in the nonnal 
plane of the pen 101 axis. Hie accelerometers 190 are shown in Figiues 9 and 10 in ghost outihie. 

10 Hw provision of die accelerometers enables this embodiment of dw pen 101 to sense motion without 

reference to surface location tags, allowing the location tags to be sampled at a lower rate. Each location tag ID can then 
identify an object of interest rather than a position on the surface. For example, if the object is a user interfile input 
element (e.g. a command button), then the tag ID of each location tag within the area of the input element can ditecUy 
Identify the input element 

15 The acceleration measured by the accelerometers in each of die x and y directions b integrated with respect to 

time to produce an instantaneous velocity and position. 

Since the starting position of the stroke is not known* only relative positions wid&in a stroke are calculated. 
AiOiough position integration accumulates errors in the sensed acceleration, accelerometers typically have high resolution, 
and die time duration of a stroke, over which errors fftMitnuhtf, is shoit 

20 7 Netpage Printer Dbsgriphon 

7.1 PRotrmt Mechanics 

The vertically-mounled netpage wallprinter 601 is shown fully assembled in Figure 11. It prinu netpages on 
Letten^A4 sized media using duplexed EMT MeoQet™ print ei^nes 602 and 603. as shown in Figures 12 and 1 2a. It uses a 
straight paper path with the paper 604 passing through the duplexed print engines 602 and 603 which print both sides of a 
25 sheet simultaneously, in fuU color and witii fuU bleed. 

An integral binding assembly 60S applies a strip of glue along one edge of each printed sheet, allowing it to 
adhere to the previous sheet when pressed agamst it This creates a final bound document 618 which can range in 
diickaess fiom one sheet to several hundred sheets. 

The replaceable ink cartridge 627, shown in Figure 13 coupled with the (hiplexed print engines, has bladdcfS 
30 or chambers for storing fixative, adhesive, and cyan, magenta, yellow, black and infrared inks. The cartridge also contains 
a micro air filter in a base molding. The micro air filter interfaces with an air pump 638 inside the printer via a hose 639. 
niis piDvides filiered air to the prindieads to prevent ingress of micro panicles into the Memjet™ printheads 350 which 
might otherwise clog the printhead nozzles. By tooorporaliog the air filter within the cartridge, the operational life of the 
filter is effectively linked to die life of die cartridge. The ink cartridge is a fully recyclable piodua widi a capaci^ for 
35 printing and gluing 3000 pages (1300 sheeu). 

Referring to Figure 13, die motorized media |rick-up roller assembly 626 pushes die top sheet direcUy fiom 
the media tray past a paper sensor on die first print engine 602 into die duplexed Memjel™ printhead asseihbly. The two 
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Memjcl^ print engines 602 and 603 are mounted in an opposing in-line sequential conftgunition along the straight paper 
path. The paper 604 is drawn into the fim print engine 602 by integral, powered pick-up rollers 626. The position and 
size of the paper 604 is sensed and Aill bleed priming oommences. Rxative is primed simultaneoosly to aid diying in the 
shortest possible time. 

5 The paper exits the first Mcmjet™ print engine 602 through a set of poweied exit spike wheeb (aiigped along 

the straight paper path), which act against a rabberized roller. These spike wheels contact the 'wet' printed surface and 
continue to feed the sheet 604 into the second Memjet™ print engine 603. 

Refenring to Figures 12 and 12a, the paper 60i passes from the duplexed print engines 602 and 603 into the 
bnider assembly 60S. The printed page passes between a powered spike wheel axle 670 with a fibious support roller and 
1 0 another movable axle with spike wheels and a momentaiy acUon glue wheel. The movable axle/glue assembly 673 is 
mounted to a metal support bracket and it is transported forward to interface with the powered axle 670 via gears by 
action of a camshaft. A separate motor powets this camshaft. 

The glue wheel assembly 673 consists of a partially hottow axle 679 with a rotating coupling for the glue 
supply hose 641 from the ink cartridge 627. This axle 679 connects lo a glue wheel, which absorbs adhesive by capillary 
1 5 action through radial holes. A molded housing 682 surrounds the glue wheel, with an opening at ihe front Pivoting side 
moldings and sprung outer doors are attached to the metal bracket and hinge out sideways when the rest of the assernbly 
673 is thrust forward. This action exposes Ihe glue wheel through the ftont of die molded housing 682, T\ension springs 
dose the assembly and effectively cap the glue wheel'during periods of inactivity. 

As the sheet 604 passes into the glue wheel assembly 673, adhesive is applied to one vertical edge on the 
20 front side (apart from the first sheet of a document) as it is transported down into the binding assembly 605. 

7<2 pRirma Controixer AnaoTHcniRE 

The netpage primer oontroUei consists of a controlling processor 750, a tactory-installcd or field-installed 
network hiterface module 625, a radio truisoeiver (transceiver controller 753. baseband circuit 754^ RF circuit 7SS, and 
RF icsonators and inductors 756). dual raster image processor (RIP) DSPs 757, duplexed piim engine controlleis 760a 
25 and 760b. flash memory 658. and 64MB of DRAM 657. as iUusUaled in Figuro 14. 

The controlling processor handles communication with the network 19 and with local wireless netpage pens 
101. senses the help button 617. controls the user interface LEDs 613-616. and feeds and synchronizes the RIP DSPs 757 
and prim engine controlleis 760. It consists of a medhim-perfofmance general-purpose micioproeessor. The connolling 
processor 750 communicates with the prim ei«me controllen 760 via a high-speed serial bus 6S9. 

30 The RIP DSPs lasterize and compress page descriptions to die netpage printer's compressed page format. 

Each print engine controller expaiuis, dithers and prints page images lo its associated Memjct^ printhead 350 in real time 
0.e. at over 30 pages per minute). The duplexed print engine controllers print both sides of a sheet simultaneously. 

The master prim engine controller 760a controls the paper transport and monitors ink usi^e in coojunction 
widi the master QA chip 665 and die ink cartridge QA chip 761 . 

35 The printer controller's flash menxny 658 holds the software for both die processor 750 and be DSPs 757. as 

well as eonfiguration data. This u copied to main memory 657 at boot time. 

The processor 750, DSPs 757. and digital transceiver components (transceiver controller 753 and baseband 
circuit 754) are integrated in a single controller ASIC 656. Analog RF components (RF circuit 755 and RF resonators and 
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inductofs 7S6) arc provided in a separate RF chip 1€2. The network interface module 625 is separate, since netpage 
princen allow the network connection to be factoiy-setecced or field-selected. Hash memory 658 and the 2a256Mbit 
(64MB) DRAM 657 is also ofT-chip. The print engine controllers 760 sue provided io separate ASICs. 

A variety of network Interface modules 623 are provided, each providing a ncipage network interface 751 and 
optionally a local computer or network interface 752. Netpage network Internet interfaces include POTS modems, Hybrid 
Fiber-Coax (HFC) cable modems, ISDN modems, DSL modems, satellite transceivers, cunent and next-generation 
oellular telephone transceivers, and wireless local loop (WLL) transceivers. Local interfeoes include IEEE 1284 (parallel 
pan)» lOBase-T and lOOBasc-T Ethernet, USB and USB 2.0, IEEE 1394 (Firewire), and various emerging home 
networking interfaces. If an Internet connection is available on the local network, dien the local network interface can be 
used as die netpage network interface. 

Ihe radio transceiver 753 communicates in the unlicensed 900MHx band normally used by cordless 
telephones, or alternatively in the unlicensed 2.40Hz industrial, sdentific and medical (ISM) band, and uses frequency 
hopping and collision detection to provide imerference-free communication. 

The printer controller optionally incorporates an Infrared Data Association (IrDA) interfece for receiving data 
"squirted"* from devices such as netpqge cameras. In an alternative embodiment, the printer uses the IrDA interface for 
short-range comnumicaiton with suitably configured neip^e pens. 

7X1 BASTBRIZATION AND PRINTING 

Once the main processor 750 has received and verified the document's page layouts and p^ objects, it runs 
the appropriate RIP software on the DSPs 757. 

Hie DSPs 7S7 rasterizc each page description and compress the rasteiized page image. The main processor 
stores each compressed page image in memory. The simplest way to load-balance multiple DSPs is to let each DSP 
rasterize a separate page. The DSPs can always be kept busy since an arbitrory number of rasierized pages can. in general* 
be stored in memory. This strategy only leads to potentially poor DSP utilitation when rasterizing short documenu. 

Watermark regions in the page descripdon are rasierized to a oontone-itsoludon bi-tevel bitmap wMch is 
losslessly compressed to negligible size and which forms part of Ihe compressed page image. 

The infrared (Ot) layer of the printed page contains coded netpage tags at a density of about six per inch. 
Each tag encodes the page ID, tag ID, and control bits, and die data content of each tag is generated during rasterization 
and stored in the compressed page image. 

Ihe main processor 750 passes back-to-back page images to the dufdexed print engine oondoUers 760. Each 
print engine controller 760 stores the compressed page image in its local memory, and starts the page expansion and 
printing pipeline. Page expansion and printing is pipelined because it is impractical to store an entire 1 14MB bi-level 
CMYK-f IR page image in memory. 

7^ Punt Engine Controller 

The page expansion and printing pipeline of the print engine controller 760 consists of a high speed IEEE 
1394 serial interface 659. a standard JPEG decoder 763, a standard Group 4 Fax decoder 764. a custom 
halftoner/compositor unit 765. a custom tag encoder 766. a line kader/fonnatter unit 767, and a custom imerfnce 768 to 
the Memjet*** printhead 350. 
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The pnnt engine controller 360 operates in a double bufTered manner. While one page is loaded into DRAM 
769 via the high speed serial interface 6S9» Ihe previously loaded page is read from DRAM 769 and passed through the 
print engine controller pipeline. Once die page has finished printing, die page just loaded is printed while another page is 
loaded. 

5 The first stage of the pipeline expands (at 763) the IPEG-compcessed contone CMYK layer, expands (at 764) 

the Group 4 Fax-compressed bi-level black layer, and renders (at 766) the bi-level netpage tag layer according to the tag 
fonnat defined in section 1.2, ail in parallel. Hie second stage dithers (at 765) die contone CMYK layer and composites 
(at 765) the bi-level Mack layer over Ihe resulting bi-level CMYK layer. The lesuttant bi-level CMYK-^^Ut dot data is 
bufTered and formatted (ai 767) for priming on die Merojet^ piindiead 350 via a set of line buffers. Most of these line 
1 0 buffers are stored in the off-chip DRAM. The final stage prints the six ehannels of bi-level dot data (including fixative) to 
theMemjet'***printhead350viathepiintheadinterto768. . 

When several print engine controllers 760 are used in unison, such as in a duplexed confignration, they are 
synchronized via a shared line sync signal 770. Only one prim engine 760, selected via the external mastei/slavc pin 771 • 
generates the line sync signal 770 onto the shared line. 

IS The print engine controller 760 contains a low-speed processor 772 for synchronizing Ihe page expansion and 

rendering pipeline, configuring the printhead 350 via a low-speed serial bus 773, and eontrolltng the stepper motors 67S, 
676. 

In the ZW* versions of the netpage printer, the two print engines eadi prints 30 Letter pages per mimite along 
the long dimension of the page (I O, giving a line rate of 8.8 kHz at 1600 dpL In the 13" versions of the netpage printer, 
20 the two print engines each prints 45 Lener pages per minute along the short dimension of dte page (8W*), giving a line 
rate of 10.2 kHz. These line rates are well within the operating frequency of the Menyet™ printhead, which in the current 
design exceeds 30 kHz. 



8 USBR INTBAFACB DIAGRAM NOTATION 

Each application user interface flow is illustrated as a collection of documents linked by command anows. A 
25 command arrow indicates that the target document is printed as a result of the user pressing Ihe cocTespondlng command 
button on the source page. Some command arrows are labelled with multiple commands separated bfy slashes (7*s), 
indicadng that any one of die specified commands causes the target document to be printed. Aldiough multiple coaunands 
may label the same command arrow, they typically have difforem side-effects. 

En application terms, it is important to distinguish between netpage documents and netpage forms. Documents 
30 contain printed infoimatioiw as well as ooiunand buttons which can be pressed by the user to request further infonnation 
or some other action. Forms, in addition to behaving like normal documents, also contain input fields which can be filled 
in by ihe user. They provide the system with a data input mechanisnt It is also useful to distinguish between documeocs 
which contain generic information and documents wliich contain infonnation spedfic to a patiicular interaction between 
the user and an application. Generic documents may be pre-printed publications such as magazines sold at news stands oi 
35 adveitising posters enooumeied in public places. Forms may also be preiwinted, including, for example, subscription 
forms encountered in pre-printed publications. They may. of course, also be generated on-the>fly by a netpage printer in 
response to user requests. User-specific documents and foims are nortnalty generated on the fly by a netpage printer in 
response to user requests. Figure 44 shows a generic document 990, a genetic form 991, a user-specific document 992, 
and a uscr-spedfic form 993. 
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Neipagcs which pankipate in a user interface flow are further described by abstract page layouu. A page 
Iqrout may contain various kinds of elements, each of which has a unique style to differentiate it torn the oihera. As 
shown in Figuie 45. these include fixed Infonnation 994. variable information 995. input fields 996^ command buttons 
997. draggable commands 998, and text hyperlinks or hypertext links 999. 

5 When a user interface flow is broken up into multiple dia^rains, any document which is duplicated is shown 

with dashed outlines in all but the main diagram which defines it. 

Conclusion 

The present invention has been described with reference to a prefcned embodiment and number of specific 
alteniative endxidimems. However, it will be appreciated by those skilled in the relevant fields that a number of other 
10 embodiments, differing fimm those specifically described, will also ftll within the spirit and scope of the piesent 
invention. Accordingly, it will be understood that the invention is not intended to be limited to the specific embodiments 
described in the present spedficalion. tnduifing documents incorporated by cfoss-referencc as appropriate. The scope of 
the invention is only limited by the attadied claims. 
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CLAIMS 

1 . A method for iegistntion of a sensing device for use with a computer systcnv the method including 

the steps of: 

providing a piinted registration fonn including registration information and coded data thereon, the coded 
data including an indication of an identity of the fonn and at least one leference point on the fom; 

iccdviog in the oomputa system indicating data fiom a sensing device, the indicating data including 
information regarding an identity of the sensing device, the identity of die form and at least one action of the sensing 
device in relation to die fonn generated by the sensing device using at least some of die coded data; 

deriving, from the indicating data, a conespondence betuveen a registered user of the computer system and the 
ideniiQf of die sensing device; and 

storing. In the computer system, icgisiraiion data associating an identity of the registered user widi the identity 
of die sensing device. 

2. The method of claim 1. wherein die at least one action of the sensing device in relatioa to ttie 
registration form includes the fonmation of handwritten text and/or mariungs on the form. 

3. The method of claim 2, wherein the indicating data regarding the formation of handwritten text and/or 
markings on the registration form is used to derive the identity of the registered user from infonnation stored in the 
computer system. 

4. Hie metiiod of daim 2, including the step of using the indicating dau regardhig the fbnnadon of 
handwritten text and/or markings on the registmtion form to geneiatc. from infomutlion stored in the computer system, a 
list form indicating registered users corresponding to ttie indicating data, the list fonn having coded data including an 
indication of an identity of the list fimn and at least one reference point on die list form. 

5. The method of claim 4, including die step of receiving in the computer system further indicating data 
from the sensing device, the further indicating data including information regarding the identity of the list form and at 
least one action of die sensing device in relation to die Ust fonn geneiaied by die sensing device using at least some of die 
coded data, the fiiither indicating data being used to determine one of die listed registered users for correspondence widi 
die sensing device. 

6. The method of dasm 1. induding: 

providing a first printed document form induding regismtion infonnation and coded data diereon. die coded 
data induding an indication of an identity of the fonn and at least one reference poim on die form; 

rccdving in die computer system indicating data from a registered sensing device, the indicating data 
induding information regarding an identity of said registered sensing device, die identity of die fonn and at least one 
action of said registerad sensing device in relation to die foim generated by said itgisleied setmng device using ot least 
some of the coded data; 

identifying a registered user of die computer system from information stored in the computer system using a 
stored conespondence between the registered user and die received identity of said registered sensing device; and 

generating said registration fonn. wherein die registration infonnadon Indudes an hidlcation of die identity of 
die regisieied user. 
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7. TKe method of claim 1, iaduding leceiving in the computer system authorising data from a second 
sensing device, the authorising data including infonnaiion regarding the identity of the second sensfaig device, the identity 
of the registration form and at least one action of the second sensing device in relation to the legistration fonn generated 
by the second sensing device using at least some of the coded data, the second sensing device being associated in the 
cooiputer system widi a second registered user authorised to permit sensing device registrations. 

8. The method of claim I, wherein the registration form is printed on demand on the surface of a sheet 
material including printing said coded data thereon. 

9. The method of claim &• including printing the coded data to be at least substantially invisible in the 
visible spectnim. 

to. A system for registralioa of a sensing device for use widi a computer system, die system including: 

a printed registration form including registration information and coded data thereon, the coded data including 
an indication of an identity of the form and at least one reference point on the form; 

a computer system adapted to receive indicating data firom a sensing device, the indicating data including 
infonnaiion regarding an identity of the sensing device, the identity of (he form and at least one action of the sensing 
device in relation to the foim generated by the senshig device osing at teast some of the coded data, the computer system 
including: 

processing means for deriving, from the indicating data, a correspondence between a registered user of the 
camputer system and the identity of the sensing device; and 

data storage for storing icgistzaiicm data associating an identity of the registered user with the identity of the 
sensing device. 

11. The system of claim 10. wherein die at least one acdon of die sensing device In relation to die 
registration form includes the formation of handwritten text andfor mariungs on the fonn. 

12. The system of claim II. wherein the indicating data regarding the formation of handwritten text 
and/lor maricings on the registration form is used to derive die identity of the registered user from information stored in the 
data storage of the computer system. 

13. The ^stem of claim 11, including a list fonn indicating registered users conesponding to the 
indicating dau and coded data, the coded data including an indication of an identity of the list form and at least one 
reference point on the list fonn, die list form being generated, from infoimation stored in die computer system, using the 
indicating data regarding the fbnnation of handwritten teat and/or markings on the legistration foms. 

14. The system of daim 10, including the sensing device which includes an identification means that 
imparts a unique identity to the sensing device. 

1 5. The system of claim 14, includmg a second sensing device with corresponding registration data stored 
in the data storage associating the identity thereof widi the registered user. 

1 6. The system of claim 1 0, including a printer for printing the registration form on demand. 

17. The qrstem of daim 16. wherein the registration fonn is printed on die surfiice of a sheet material 
induding printing said coded data Ihcreon. 
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18. Hie sytiem of claim 17, inducting printing the coded data Co be at least substantially invisible in Che 
visible spectnim. 



wo 01/03016 



1/47 



PCT/AVOO/007dS 



REQUEST FORM 



MAME 
ADDRESS [ 



L 



CSUgMIT) 






FIG. 1 



wo 01/03016 



2/47 



PCT/AU00/0O76S 







NETPAGE 






APPLICATION 






SERVER 



13 



NETPAGE 
PAGE SERVER 



10 



NETPAGE 
PRINTER 




3- >^ 



□ 



5^ 



I01 



FIO. 2 



wo 01/03016 



3/47 



PCT/AUOO/00765 




wo 01/03016 



PCT/AUOO/00765 



4/47 



NETPAOE PAGE SERVER 
-10- 



CONTENT 
OBJECT 



DOCUMENT 
DESCRIPTION 



PAGE 
DESCRIPTION 



GRAPHIC 
ELEMENT 



INTERACTIVE 
ELEMENT 



DOCU 
INST/ 


MENT 
^NCE 














NETPAGE 
DOCUMENT 





45 



PHYSICAL WORLD 



PAGE 
INSTANCE 



PAGE ID ^ 



FIELD 
VALUE 



50 




VISIBLE 
GRAPHIC DATA 



INVISIBLE 
CODED DATA 



50 



INVISIBLE 
TAG 



PAGE ID 4^ 
POSITION 



F\G. 4 




FIO. 6 



wo 01/03016 



PCT/AU0O/0076S 



6/47 



ACQUIRE IMAGE 
& SET THRESHOLD 



■20 



( DECODED ^ 



39 



IMAGE & 
THRESHOLD 




THRESHOLD 
& SEGMENT 



22 



(SHAPE 
LIST J 



23 



REED-SOLOMON 
DECODE 



38> 



( ENCODED ^ 



37 



30' 



SAMPLE 
DATA POINTS 



4^ 


COMPUTE 


35^^ 


MOMENTS 



50 PEN 
XFORM 



J 



(SHAPE 
MOMENTS J 



25 34' 



FIND 
RING TARGET 



26 



(ROTATION 
& ASPECT J 



27 



FIND 
AXIS TARGET 



'23 



C 



YAW 




INFER 

3D PEN XFORM 



r PERSPECTIVE^ 

XFORM J 3 



33 



INFER 
PERSPECTIVE XFORM 



32 



C 



CORNER 
POINTS 




FIND PERSPECTIVE 
TARGETS 



■30 



FIG. 7 



wo 01/03016 



7/47 



PCT/AU0O/0O76S 




FIG. & 



wo 01/03016 



9/47 



PCT/AIlOO/00765 
















r ™ " — " ^ 

1 • 


Itr, I < ! 


1 ^ 
—A 


SENSOR 
IR LED 




-T-V 



-N 



<UJ 



in 



V 



UJ 



in 



wo 01/03016 



PCT/AU00/M76S 



10/47 




FIO. 11 



WO01>0301< 



PCT/AU0(MIO7fiS 



11/47 




FIG. 12 



wo 01/03016 



12/47 



PCT/AUOQ/007dS 




FIO. 12a 



wo 01/03016 



13/47 



PCT/AUO0/0O76S 




wo 01/03016 



14/47 



PCT/AUOO/00765 




5§ 



wo 01/03016 



PCT;AUOO/00765 



15/47 




wo 01/03016 



PCT/AUOO/00765 



16/47 




wo 01/03016 



17/47 



PCT/AU00/0O76S 




wo 01/03016 



18/47 



PCT/AUOO/00765 




wo 01/03016 



PCT/AUOO/007fiS 



19/47 




FIO. 19 



wo 01/03016 



20/47 



PCT/AUOO/00765 




WO01/II30U! 



21/47 



PCT/AU00/0O76S 



NETPAGE 
PRINTER 



802 



NETPAGE 

USER 
PRINTER 



DEFAULT 
ADMIN 



NETPAGE 

USER 
DIRECTORY 

-P 



3O0 
0.1 



323 



935 



NETPAGE 
USER PRINTER 
ACCOUNT 



BALANCE 



936 



NETPAGE 
USER 



USER ID 



CONTACT 
DETAILS 



NAME 

ADDRESS 

TELEPHONE 



GLOBAL 
PREFERENCES 



PRIVACY 

DELIVERY 

LOCALIZATION 



317^ 



BIOMETRIC 

A 



NETPAGE 
PEN 



eo 



3cn 



NETPAGE 

USER 
ACCOUNT 



BALANCE 



'320 



SET 
PAYMENT 
CARD 



ACCOUNT INFO 
PUB SIG KEY 
PRIV SIG I^EY 
SECRET 



■321 



HANDWRITING 
MODEL 



■322 



313^ 



SIGNATURE 
BIOMETRIC 



SIGNATURE 



FINGERPRINT 
BIOMETRIC 



■319 



FINGERPRINT 



FIG. 21 



wo 01/03016 



22/47 



PCT/AU0O/OO7«S 



WE& 
TERMINAL 



TERMINAL ID 
PUB S\G KEY 



309 



NETPAGE 
PRINTER 



PRINTER ID 
SECRET 
PUB S\G KEY 
LOCATION 
ADMIN'D 



NETPAGE 
PRINTER PROV 
ACCOUNT 



BALANCE 



314 



;ey \ 



T 
34 



SURFACE 
TYPE 



^7^ 
310 



NETPAGE 
PRINTER 
PROVIDER 



PRI PROV ID 

7^ 



313 



0.1 



300 



NETPAGE . 
USER ! 



TAG 
MAP 



311 



TAG 
INFO 



TAG ID 

LOCATION 



312 



FIG. 22 



NIB 



NIB ID 

/-^0.1 



324 



NETPAGE 
PEN 



PEN ID 
KEY-EXCH KEY 



301 



0.1 



61 



CURRENT 

SELECTION 



CAPTURE TIME 
REGION 
PAGE ID 



32e 



NIB 
STYLE 



SHAPE 
SIZE 
COLOR 
TEXTURE 



! FAGE 1 
! INSTANCE ! 



330 



FIG. 23 



WO01/030K PCT/AVOO/l0O7(5 

23/47 



NETFAGE 
PU&LISHER 



7=^ 
aoe 



PUBLICATION 



7^ 
307 



SUB5CKIFTI0N 



FREQUENCY 



30& 

0.1 



ao2 



1 NETPAGE I 
I PRINTER ; 



NETPAGE 
APPLICATION 
PROVIDER 



APP PROV ID 



7=^ 
803 



NETPAGE 
APP PROV 
ACCOUNT 



BALANCE 



7^ 
327 



APPLICATION 



APPLICATION ID 
CERTIFICATE 



304- 



0.1 



e4- 



APPLICATION 
USER 



ALIAS ID 
PUB SIG K.EY 
PRIV SIG KEY 

7=7 

305 



65 



FAVORITE 
APPLICATION 



PRODUCT TYPE 



300 



7^ 

323 



NETPAGE 
USER 



f\G. 24 



wo 01/03016 



PCT/AU00W>7<S 



24/47 



PAGE 
SERVER 



SERVER IP 



53 



RESOURCE L 
DESCRIPTION : 




DOCUMENT 



DOCUMENT ID *j 
APP ID 
USER ID 



7=^ 
330 



334 



51 



CONTENT 



OBJECT ID 



0.1 



DOCUMENT 
ELEMENT 



337 



GKOUF 
ELEMENT 



0.1 



340 



I TERMINAL 
' ELEMENT 



FORMATTED 
DOCUMENT 



PAGE SIZE 
SCALE FACTOR 
USER ID 




PAGE 
DESCRIPTION 



7=^ 

5 



DOCUMENT 
INSTANCE 



DOC INST ID 
CREATION TIME 
USER ID 
PRINTER ID 




331 



FORMATTED 
ELEMENT 



ZONE 



PAGE 
INSTANCE, 



PAGE ID 
CREATION TIME 
USER ID 
PRINTER ID 




330 



T 

53 



ELEMENT 
INSTANCE 



311 



BACKGROUND 
FIELD 



TAG 
MAP 



DIGITAL INK. 
333 



FIG. 25 



wo 01/03016 



PCT/AUOO/0076S 



25/47 



NETPAGE 
U5E^ 

&0O 



10.1 



DOCUMENT 



&30 



APPUCAWN 



FORMATTED 
DOCUMENT 



DOCUMENT 
INSTANCE 



1.- 

336 
'^334 
331 

r-" r- 
0.1 ; 



304 



. PAGE I* 
; INSTANCE ; 



NETPAGE 
PRINTER 



302 



FIG. 26 



1 STATIC 
": ELEMENT 



343 



TERMINAL /I 
ELEMENT fN 

339 



J HYPERLIKlt^ 
' ELEMENT 



FIELD 
ELEMENT 



34A 



345 



' PAGE SERVER 
-i COMMAND 
. ELEMENT 



34e 



FIG. 27 



WO01/030K 



26/47 



PCT/AUOO/0076S 



STATIC Ml 
ELEMENT Nr" . 



343 



STYLE 
ELEMENT 



TE)aFLOW 
ELEMENT 



TEXTFLOW IP 



IMAGE 
ELEMENT 



GRAPHIC 
ELEMENT 



VIDEO CLIP 
ELEMENT 



AUDIO CLIP 
ELEMENT 



SCRIPT 
ELEMENT 



547 



a4a 



349 



350 



351 



352 



353 



STYLE 
OBJECT 



STYLED 

TEXT 
OBJECT 



IMAGE 
OBJECT 



GRAPHIC 
OBJECT 



VIDEO CLIP 
OBJECT 



AUDIO CLIP 
OBJECT 



SCRIPT 
OBJECT 



354 



355 



357 



353 



359 



3eo 



FIG, 2& 



WO01/030K 



PCT/AUO0/OO7<S 



27/47 



HYFERLINK> 
ELEMENT 



APPLICATION ID 
LINK ID 
ALIAS REQ'D 
DESCRIPTION 



TERMINAL • 
ELEMENT ' 



339 




362 



FIG. 29 



344 



HYPERLINK. 



, ELEMENT , 



GENERAL 
HYPERLINK. 



SELECTION 
HYPERLINK 



FORM 
HYPERLINK 



SUBMIT DELTA 



303 



■364 



363 



FIG, 50 



wo 01/03016 



28/47 



PCT/AU00/0O76S 



GROUP 
ELEMENT 



<3- 



HYPERLINKEP 
(3R0UP 



J HYPERLINK. . 
; ELEMENT J 

'--^ 

344 



FIO. 31 



I (3R0UP 

: ELEMENT -T^^^ 



1 



I 



FORM 



APPLICATION ID 
FORM ID 
LIFETIME 



7^ 



363 



* • 



FIELD 
ELEMENT 



!-i>: 



5^ 



NEXT 
VERSION 



345 



FORMATTED 
FIELD 



FORM 
INSTANCE 



FREEZE TIME 
EXPIRY TIME 



FORM 
STATUS 



59 



369 



FIELD 
INSTANCE 



372 



370 



TERMINAL I 

ELEMENT ; 



FORMATTED I 

ELEMENT ' 



ELEMENT I 

INSTANCE ; 



332 



FIELD 
VALUE 



DIGITAL INK 



(37/ 



F/a 52 



wo 01/03016 



PCT/AU00/0076S 



29/47 



DIGITAL 
INi; 



&73 



STROKE 
GROUP 



CREATION TIME 




TIME OFFSET 
XY POSITION 
XYZ ROTATION 
Z FORCE 

~^ 

576 



STYLE 1 



325 



FIG, 53 



FIELD 
ELEMENT 



FIELP NAME 
HIPPEN 



345 



J CHECKBOX 
! FIELP 



J TEXT [ 
: FIELP : 



I 



! DRAWING I 
~ FIELD : 



■ 377 



'373 



379 



SIGNATURE ^^330 
FIELD 



FIG. 34 



wo 01/03016 



30/47 



PCT/AUOO/007^ 





CHECKBOX 
FIELD 


NJ FIELD I 
l/j ELEMENT ; 


377 K 345 




CHECKBOX 
FIELD 
VALUE 


nJ field I 

Ix^, VALUE J 




BOOLEAN 






f\G. 55 




TEXT 
FIELD 


FIELD 1 

1^ ELEMENT ; 


373 Y 345 




TEXT 
FIELD 
VALUE 


nJ field I 
I/; VALUE ; 




TEXT 






FIO. 36 




SIGNATURE 
FIELD 


k) field I 

element ; 


330 Y ^ 




SIGNATURE 
FIELD 

VALUE 


k] field J 

\^\ VALUE ; 




DIGITAL 51G 





FIG. 37 



wo 01/03016 



31/47 



PCT/AUOO/0076S 



I. 



RECEIVE 
STROKE 



334 



IDENTIFY 
PAGE 



335 



RETRIEVE 
PAGE 



I 



IDENTIFY 

PAGE 
ELEMENT 



336 



337 




392 



APPEND 
STROKE TO FIELD 
DIGITAL INK 



APPEND STROKE 
TO BACKGROUND 
FIELD DIGITAL INK 



COPY 
STROKE TO 
SELECTION 



7^ 
39^ 



. INTERPRET • 
! DIGITAL INK ! 



393 

HAS 
HYPERLINK? 




ACTIVATE 

HYPERLINK 



I 



FIG. 33 



wo 01/030K PCT/AU00/0O76S 

32/47 



396 



a97 



393 




399 



900 




A55I(3N 
TRUE AS 
FIELP VALUE 



'393- 



CONVERT 
DIGITAL INK. 
TOTEJa 



VERIFY 
DIGITAL INK AS 
SIGNATURE 



ASSIGN 
TEXT AS 
FIELD VALUE 



901 



^04 



CREATE 
DIGITAL 
SIGNATURE 



905^ 



ASSIGN DIGITAL 

SIGNATURE 
AS FIELD VALUE 



FIG. 53a 



wo 01/03016 



PCT/AUOO/0076S 



33/47 



PAGE SERVER 
COMMAND 
ELEMENT 



HIDDEN 



9oe 



PAGE SERVER 
COMMAND 



ON SELECTED 



907 



FORM M. 
COMMAND NT 



PAGE M 
COMMAND N" 



DOCUMENT 
COMMAND 



4 



VOID 
FORM 



DUPLICATE 
FORM 



RESET 
FORM 



GET FORM 
STATUS 



DUPLICATE 
PAGE 



RESET 
PAGE 



GET PAGE 
STATUS 



DUPLICATE 
DOCUMENT 



RESET 
DOCUMENT 



GET 
DOCUMENT 
STATUS 



903 



909 



910 



911 



912 



913 



914 



915 



9ie 



917 



FIG. 59 



wo 01/03016 



34/47 



PCT/AU00/0076S 



APPLICATION 

(PUBLISHER) 



IP 

SERVER 



PAGE 
SERVER 



"GET ID" 



/2 10 



DOC ID-«-5/ 



APPID.-«-64 

ALIAS ID, 4 65 

DOC ID. 
DOCUMENT, 
DIGITAL SIGNATURE. 
MULTICAST CHANNELS 



REG 
SERVER 



5^-^ PAGE IDS 



7^ 
11 



PRINTER 



7=^ 
601 



APP ID. 
ALIAS ID 



USER ID. ^0(9 
PRINTER ID,*-g2 
CERTIFICATE 



PAGES, 

MULTICAST CHANNELS 



OBJECTS (MULTICAST) 

FIG. 40 





PAGE ; 

SERVER I 

NETPAGB 1 
USER \" 

&00 



341 



362 



HYPERLINK 
REQUEST 



REQUEST ID 
EXPIRY TIME 
USER ID 
PRINT ER ID 



934 



52 



HYPERLINK. 
INSTANCE 



NETPAGE 
PRINTER 



302 



FIG. 41 



wo 01/03016 PCT/AU0O/0O76S 

35/47 



PRINTER 



7=^ 



PAGE 
SERVER A 



REG 
SERVER 



601 



PEN ID, 
PRINTER ID 
PAGE ID, 
CLICK, n 



50 



lOa 



53- 
52- 
54- 
55- 



APP 



PEN ID. 
(APP ID) < 



7^ 

11 71 



61 

-04 



ID 

SERVER 



USER ID <-60 
(ALIAS \D)^e5 



7^ 
12 



PAGE 
SERVER B 



SERVER ID, 
HREQ ID. 
LINK ID. 
(TRANS ID) 
(ALIAS ID) 



USER ID. 
PRINTER ID 



e2 



7=^ 

lOt^ 



"GET ID" 



DOC ID«»-5/ 



SERVER ID. HREQ ID. 
APP ID, 
DOC ID. DOC 



HREC3 ID 
APP ID 



SO-*' PAGE IDS 



PAGES 

FIG, 42 



wo 01/03016 



36/47 



PCT/AU0O/0O7(»S 



PRINTER 



7^ 



PAGE 
SERVER A 



REG 
SERVER 



PEN IP. 
PRINTER IP 
PAGE IP. 
CLICK 



50 



53- 
52-* 
54^ 

55- * 

56- *- 



lOa 



APP 



IP 

SERVER 



PEN IP.4- 
APP IP 



USER IP.; 
ALIAS IP 



// 71 



ei 

-64 



SERVER IP. 
HREQ IP. 
LINK. IP, 
TRANS IP. 
ALIAS IP. 
FORM IP. 
FORM PATA 



60 
-65 



7=^ 
12 



PAGE 
SERVER P 



"ALIAS IP 



CERTIi 



FICAll 



USER IP. 
PRINTER IP 



62 



7=^ 

10^7 



'GET IP" 



DOC ID «-5/ 



SERVER IP. HREQ IP. 
APP IP, POC ID. POC 



HREQ IP 
APP IP 



50-*^ PAGE IPS 



PAGES 



FIG. 43 



wo 01/03016 



PCT/AU0O/0O76S 



37/47 



GENERIC 
DOCUMENT 



7=7- 

990 



GENERIC 
FORM 



USER 
DOCUMENT 



USER 
FORM 



991 



992 



7=^ 
993 



FIG, 44 



FIXED INFOfZMATION 994 

; varIable information V 

C COMMAND BUTTON 990 



INPUT FIELD 



995 



997 



|#| DRAGGABLE COMMAND | ^ 993 



FIG. 45 



WO01/0301« PCT/AU0O/0O76S 

38/47 



\ 




\ 












HELP 


ADD USER 


ADO 


SUBMIT 


USER 


PAGE 


► 


USER 
1 1 


p 


ADDED 



46 



500 



501 



FIO. 46 



WO«l/tt301« 



39/47 



PCT/AUO0iM)O7<S 



APP U5E^ 



PAGE 1 OF 1 



TITLE 


TITLE 






FII^STNAME 


FIRST NAME 


INITIALS 


INITIALS 


NICKNAME 


NICKNAME 


FAMILY NAME 


FAMILY NAME 










STKEET 
ADDRESS 


STREET ADDRESS 1 


STREET ADDRESS 2 


CITY 


CITY 


STATE 


STATE 


ZIP CODE 


ZIP CODE 


COUNTRY 


COUNTRY 



502 



\ 



>504 



J 



WORK PHONE 
M03ILE PHONE 
HOME PHONE 



PRIVACY 
OPTIONS 



WORK PHONE NUMBER 



MOBILE PHONE NUMBER 



HOME PHONE NUMBER 



506 



514 



□ PONT PUBLISH NAME IN USER LIST \ 
[U PONT PUBLISH ADDRESS i 

□ DONT PUBLISH PHONE NUMBERS f 

□ ONLY ACCEPT E-MAIL FROM CONTACT^ 



PRMLEOES '^^^-^ ADMINISTRATOR 
500 



ADMINISTRATOR SIGNATURE 



510 
( SUBMIT ) 



FIG. 47 



wo 01/03016 



PCT/AUOO/007«S 



40/47 



SUBMIT 
(UNK.NOWN USER) 



ADD PEN 
W/ NEW FEN 



' 524 



ADD 
FEN 



SUBMIT 
W/ NEW FEN 



SUBMIT 

(AMBIGUOUS USER) 



ADD FEN 
MATCHING 
USEi^S 



HELP 
PAGE 



46 

ADD PEN 
W/ OLD FEN 



523 



ADD PEN 



ADD 

PEN 



ADD PEN 
TO LOCAL USER 



SUBMIT 
W/ NEW FEN 



526 



530 



PEN 

ADDED 



ADD PEN 



ADD FEN 
LOCAL 
USERS 



■532 



FIG. 48 



WO01/030K 



PCT/AU0O/0O76S 



41/47 



APP FEN TO USER 



PAGE 1 OF 1 



FIRST NAME 
NICKNAME 
FAMILY NAME 



FIK5T NAME 



INITlALe INITIALS 



NICK.NAME 



FAMILY NAME 



534 



524a 



APP FEN TO U5ER 



FAGE 1 OF 1 



FIRST NAME 


; FIRST NAME 


: INITIALS ; INITIALS ; 


NICKNAME 


; NICKNAME 


• 
1 


FAMILY NAME 


; FAMILY NAME 


1 

1 



535 




FIG. 49 



wo 01/03016 



PCT/AU0Q/007«S 



42/47 



APP PEN TO U5EP. 
- MATCHING U5EK5 



PAGE 1 OF 1 



FIR5T NAME ', FIRST NAME 



NICKNAME 



\ NICI^NAME 



FAMILY NAME \ FAMILY NAME 



INITIALS \ INITIALS 



540 



( APPPEN ) 

( apppen"^ 

( APP PeQ 



\ user name 
: user'name' 

— — . 

: user'name" 



>542 



( APPPEN ) i'uSER'nAMe" \j 



1 

FIG. 50 



WO0iy03016 



PCT/AU00/0076S 



43/47 



APP PEN TO USER 
- LOCAL USERS 


FAGE 1 OF 1 


FIRST NAME 


: FIRST NAME 


\ INITIALS \ INITIALS 


; > 




NICKNAME 


; NICI^NAME 






>544 


FAMILY NAME 


; FAMILY NAME 




\ 


\ ■ 








\\ 




( ADD PEN ) 


: USER NAME 






C ADD PEN ^ 


: USER NAME 








( ADD PEN ) 


: USER NAME 






}543 










( ADD PEN ) 


; USER NAME 




'J 















1 

532 

FIG. 51 



wo 01/03016 



44/47 



PCT/AU0O/0O7«S 



SUBMIT 
(UNKNOWN USER) 



AUTH USER 



AUTH 
USER 



SUBMIT 



SUBMIT 

(AMBIGUOUS USER) 



AUTH USER] 
MATCHIN(3 
USERS 



4e 



HELP 
PAGE 



AUTH USER 
W/ USER PEN 
H 



■55& 



1 1 




AUTH 

r 


AUTH 
USER 






1 V 



AUTH 
GLOBAL USER 



SUBMIT 



556 



560 



USER 
AUTH'P 



AUTH USER 



AUTH USER! 
GLOBAL 
USERS 



f\G. 52 



wo 01/03016 



PCT/ADOO/00765 



45/47 



AUTHOIZIZE USEI^ ON FRINTER 



PAGE 1 OF 1 



FIRST NAME 
NICKNAME 
FAMILY NAME 



FIRST NAME | INITIALS 



INITIALS 



NICKNAME 



FAMILY NAME 



564 



554a 



AUTHOKIZB USER ON FmNTEl^ PAGE 1 0F i 

'] INIVALS [FNlflALS 



Flf^TNAME : FIRST NAME 
NICKNAME : NrclcN AME " 
FAMILY NAME 'FAmIlYNAMe" 



565 




5541?/ 5561? 



FIG, 53 



WO01/«3016 PCT/AUO<W)07« 

46/47 



AUTHORIZE U5ER ON FRINTEK 
- MATCHING USERS 



PAGE 1 OF 1 



FIRST NAME 
NICKNAME 
FAMILY NAME 



; first name 
[nFcVname'' 
famIlyname 




570 



Cauth user) [user'name 

Cauth user) iuser'name"""""' 

Cauth user) [user'name' " 

Cauth user) [user'name" 



>572 



J/ 



T 

55& 



FIG. 54 



wo 01/03016 



PCT/AU00/0O7«5 



47/47 



AUTHOI^IZE USER ON FmTEK 
' GL03AL U5EK5 



FAGB 1 0F 1 



FIRST NAME ; FIRST NAME I INITIALS INITIALS 



NICKNAME 


I NICKNAME 




1 
1 


FAMILY NAME 


: FAMILY NAME 




1 
1 



574 



user name 
user'name" 
user"name' 



(AUTH user) 
(AUTH user) 

(AUTH user) 

(AUTH USER) !USER"nAMe' 



>5Z9 



1 

562 

FIG. 55 



